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I.  Introduction 

In  many  applications  such  as  high  speed  digital  signal  processing,  reliable  simulations  of  dynamical  systems, 
digital  implementation  and  simulation  of  chaotic  systems,  etc.,  effects  of  finite  wordlength  are  a  critical 
issue.  The  process  of  actual  digital  computer  implementation  of  a  given  ideal  dynamical  system  can  be 
characterized  by  several  open  parameters  that  have  a  critical  impact  on  the  performance  of  the  actually 
implemented  algorithm: 

1.  The  realization  (in  the  linear  case,  the  system  matrices):  This  determines  the  coefficients  involved,  the 
order  of  computation,  etc.  There  are  infinitely  many  realizations  for  implementing  the  same  dynamical 
system. 

2.  The  arithmetic  format:  This  determines  the  type  of  arithmetic  used  (fixed  point,  floating  point,  etc.), 
the  register  lengths,  and  the  type  of  quantization  operations  in  the  reformatting  processes. 

For  the  class  of  linear,  time-invariant  systems,  5-operator  based  implementations  were  shown  to  perform 
superior  relative  to  their  g-operator  based  counterparts,  if  the  sampling  rate  is  chosen  sufficiently  small  [1,2]. 
These  advantages  of  the  5-operator,  especially  in  high  speed,  real-time  applications,  were  demonstrated 
with  respect  to  quantization  noise  at  system  output  and  differential  sensitivity  of  the  frequency  response 
with  respect  to  coefficients  of  system  realization  [1-4].  In  addition,  the  use  of  5-operators  allows  a  unified 
treatment  of  both  the  continuous  and  discrete  time  cases.  These  properties  make  5-operator  based  systems 
an  attractive  alternative  to  conventional  system  realizations. 

However,  a  number  of  questions  on  5-operator  based  implementations  remained  unanswered: 

1.  Do  the  advantages  that  have  been  demonstrated  for  the  linear  time-invariant  case  carry  over  to  the  2-D, 
m-D,  and  possibly  nonlinear  cases?  If  so,  5-operator  based  numerical  schemes  can  provide  a  completely 
novel,  simple,  widely  applicable,  yet  more  reliable  methodology  for  system  simulation  and  realization. 
The  fundamental  importance  of  such  an  investigation  was  identified  at  the  very  outset  by  the  PFs. 

2.  What  about  asymptotic  stability  of  5-operator  systems  and  the  possibility  of  limit  cycles?  Although 
quantization  noise  at  the  output  was  shown  to  be  smaller  for  5-system  realizations,  this  does  not  au¬ 
tomatically  preclude  the  existence  of  limit  cycles.  In  fixed  point  implementations,  the  existence  of 
prohibitively  large  limit  cycles  was  evident.  Although  in  almost  all  applications  such  behavior  is  unac¬ 
ceptable,  no  attention  had  been  directed  towards  this  seemingly  generic  phenomena  of  5-systems. 

The  above  questions  are  at  the  core  of  this  research  project.  This  report,  which  provides  a  description  of  the 
work  carried  out  under  this  research  project,  is  structured  as  follows:  In  Section  II,  a  brief  description  of  the 
proposed  tasks  is  outlined.  In  Section  III,  the  results  obtained  are  briefly  described  on  a  qualitative  level  for 
each  of  the  problem  areas  tackled.  Section  IV  offers  conclusions  and  summarizes  the  accomplishments  and 
their  significance.  Section  V  contains  pertinent  references.  More  detailed  technical  decriptions  of  the  results 
in  Section  III  may  be  found  in  several  technical  papers,  and  these  are  included  in  Appendix  A,  It  contains 
all  those  papers  that  have  already  been  published  in  or  submitted  to  journals  or  conferences  as  well  as  all 
material  (such  as,  presentations,  summaries,  etc.)  that  has  been  submitted  to  ONR.  Appendix  B  contains 
those  technical  papers  that  have  some  peripheral  relevance  to  the  proposed  research,  and  those  in  which 
acknowledgement  of  ONR  support  is  given. 
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II.  Brief  Description  Tasks 

The  proposed  work  was  divided  into  three  major  tasks: 

Tl:  Analysis  and  design  of  finite  wordlength  implementations  of  linear  time-invariant  5-systems. 

T2:  Analysis  of  nonlinear  circuits  through  5-operator  based  schemes. 

T3:  2-D  and  m-D  5-system  models. 

Task  1  reveals  some  fundamental  difficulties  in  the  implementation  of  5-systems  with  fixed  point  arith¬ 
metic.  It  focuses  mainly  on  zero  convergence  of  the  free  system  response  and  exposes  the  existence  of  limit 
cycles  as  well  as  effects  of  sampling  time  A  quantization. 

Task  2  is  a  study  of  whether  the  superior  finite  wordlength  properties  associated  with  certain  linear 
time-invariant  system  realizations  also  extend  to  nonlinear  systems.  This  work  was  mainly  motivated  by 
some  very  promising  simulation  results  of  chaotic  systems. 

Task  3  develops  the  formalisms  for  2-D  and  m-D  system  descriptions  in  5-operator  form.  It  also  investi¬ 
gates  sensitivity  properties  of  these  proposed  m-D  5-models  and  compares  them  with  conventional  ^-models. 
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III.  Results  and  Accomplishments 

This  section  offers  brief  qualitative  descriptions  of  the  results  obtained  during  this  project  period.  A  more 
rigorous  quantitative  analysis  of  these  results  are  to  be  found  in  Appendix  A  which  contains  all  relevant 
technical  papers. 

111.1  Task  1;  Analysis  and  Design  of  Finite  Wordlength  Implementations  of  Linear  Time- 
Invariant  Systems 

We  have  exposed  a  serious  limitation  of  ^-operator  based  realizations  of  discrete  time  systems:  they  cannot 
be  free  of  limit-cycles  when  used  with  small  sampling  times  and  fixed  point  arithmetic!  In  particular,  DC 
limit  cycles  are  always  present  when  sampling  time  is  smaller  than  0.5  for  rounding,  and  1.0  for  truncation. 
In  other  words,  under  these  conditions,  nonzero  initial  conditions  can  be  found,  such  that  the  asymptotic 
response  converges  to  an  incorrect  equilibrium  point  different  from  the  origin  [5].  This  in  fact  is  a  generic 
problem  with  6-systems  in  the  sense  that  it  is  independent  of  the  margin  of  stability  (of  the  ideal  linear 
system)  and  its  realization.  The  main  cause  of  this  lies  in  the  update  equation  where  multiplication  by 
sampling  time  (which  is  typically  small)  occurs.  This  results  in  a  difference  vector  that  quantizes  to  zero. 

The  use  of  novel  quantization  schemes  with  smaller  deadzones  was  also  shown  to  be  ineffective:  Although 
quantizers  that  significantly  reduce  DC  limit  cycle  amplitude  may  be  selected,  new  oscillatory  limit  cycles 
are  usually  created.  A  newly  developed  computer-aided  search  algorithm  for  the  existence  of  limit  cycles 
may  be  effectively  used  to  investigate  this  phenomenon  [6].  Through  construction  of  deadband  regions  and 
simple  bounding  hypercubes,  these  limit  cycle  amplitudes  have  been  shown  to  grow  with  increasing  sampling 
rate  [6,7].  Using  results  on  necessary  1-D  conditions  for  stability  of  m-D  systems  [8],  m-D  6-systems  were 
also  shown  to  produce  similar  limit  cycle  behavior  [7,9]. 

Another  drawback  of  fixed  point  6-operator  implementations  is  the  required  high  dynamic  range  of 
coefficients  and  signals.  This  is  due  to  the  fact  that,  given  a  ^-system,  in  obtaining  the  corresponding  6- 
system,  a  division  by  A  (which  is  typically  small)  is  involved.  Hence,  additional  bits  in  coefficient/signal 
registers  are  generally  required  to  avoid  overflow  [10]. 

The  above  investigations  produced  the  following  unavoidable  conclusion:  Since  6-operator  formulated 
discrete  time  systems  are  superior  to  their  ^-operator  counterparts  only  when  the  sampling  rate  is  chosen  to 
be  significantly  smaller  than  one,  fixed  point  arithmetic  is  not  a  suitable  format  for  6-system  implementations. 

The  situation  is  refreshingly  different  in  floating  point  arithmetic:  The  above  mentioned  problems  (en¬ 
countered  under  fixed  point  arithmetic)  vanish  and  6-systems  produce  significant  advantages  under  high 
speed  conditions.  We  show  that,  under  floating  point  format,  a  stable  linear  system  (independent  of  realiza¬ 
tion)  can  always  be  implemented  limit  cycle  free  in  the  regular  dynamic  range  [11].  Equivalently,  limit  cycles 
can  always  be  restricted  into  underflow  conditions.  Such  limit  cycles  are  acceptable  for  most  applications. 
Furthermore,  the  large  dynamic  range  requirements  of  6-systems  may  easily  be  accommodated  in  floating 
point  arithmetic. 

For  both  fixed  and  floating  point  systems,  new  differential  sensitivity  measures  which  are  widely  applica¬ 
ble  even  to  nonlinear  and  time- variant  systems  were  developed  [10,12].  Instead  of  using  sensitivity  measures 
related  to  frequency  response  (as  is  the  usual  practice),  a  time  domain  approach  using  state  space  methods 
was  developed.  Sensitivity  of  state  trajectory  with  respect  to  system  coefficients  and  initial  conditions  was 
investigated.  For  linear  time-invariant  systems,  6-operator  based  implementations  have  been  shown  to  yield 
lower  (by  a  factor  A)  sensitivity  than  their  g-operator  based  counterparts.  Sensitivities  with  respect  to  initial 
conditions  are  shown  to  be  identical  for  both  implementations. 

111.2  Task  2:  Analysis  of  Nonlinear  Circuits  Through  6- Operator  Based  Schemes 
The  following  aspects  of  nonlinear  6-systems  were  addressed  in  detail: 

(a)  Sensitivity  of  state  response  with  respect  to  coefficients  of  the  nonlinear  equation:  This  analysis  was 
carried  out  for  various  types  of  nonlinearities  as  well  as  for  both  fixed  and  floating  point  schemes  [10,12]. 

(b)  Bounds  on  quantization  error  magnitudes,  required  dynamic  range  and  construction  of  majorant  systems 
for  the  response  of  6-operator  based  implemented  nonlinear  systems  [10]. 
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In  part  (a),  the  concept  of  differential  sensitivity  of  state  response  with  respect  to  coefficients  of  the  nonlinear 
equation  was  developed.  The  proposed  sensitivity  measures  were  evaluated  for  linear  systems,  piece- wise 
linear  systems,  systems  with  nonlinearities  and  systems  with  piecewise  nonlinearities. 

For  all  these  types  of  nonlinear  systems,  sensitivity  of  a  5-system  with  respect  to  coefficients  was  shown 
to  be  smaller  (by  a  factor  A)  than  that  for  its  corresponding  g-system  under  fixed  point  arithmetic.  For 
piece-wise  linear  and  piece-wise  nonlinear  systems,  development  of  a  quantitative  measure  for  sensitivity 
of  state  trajectory  with  respect  to  initial  conditions  was  required  as  well.  This  is  due  to  how  the  piecewise 
characteristics  of  the  nonlinearity  is  modelled.  This  proposed  sensitivity  measure  was  shown  to  be  comparable 
for  both  g-  and  5-systems. 

Of  course,  nonlinear  5-systems,  implemented  in  fixed  point  arithmetic,  can  be  shown  to  suffer  from 
the  same  generic  problem:  Existence  of  incorrect  equilibria.  Since  this  is  a  serious  problem  especially  in 
implementation  and  simulation  of  nonlinear  systems,  floating  point  arithmetic  was  also  intensively  analyzed 
as  an  alternative.  Suitable  sensitivity  measures  were  developed  and  evaluated  for  the  nonlinear  system  types 
mentioned  above.  A  comparison  with  corresponding  g-operator  based  systems  revealed  what  we  believe  to  be 
a  very  important  observation:  Under  mild  conditions  on  the  coefficients  of  the  ^-system,  the  state  trajectory 
of  the  corresponding  5-system  is  less  sensitive  than  that  of  the  ^-system.  These  conditions  turn  out  to  be 
routinely  satisfied  if  the  nonlinear  discrete  time  system  is  obtained  through  sampling  of  a  given  continuous 
time  system  with  a  high  sampling  rate! 

In  part  (b),  a  comparison  between  q-  and  5-systems  was  conducted  via  quantization  error  bounds.  For 
the  fixed  point  case,  the  g-system  is  always  inferior  to  the  5-system,  i.e.,  it  produces  larger  quantization 
error  bounds  whenever  single  length  accumulators  are  used  or  when  the  number  of  computations  in  the  state 
equation  significantly  exceeds  the  number  of  computations  in  the  update  equation. 

Systems  with  polynomial  type  nonlinearities  has  been  investigated  in  great  detail.  For  this  class  of 
nonlinearities,  recommendations  for  the  sampling  rate  which  would  provide  an  optimal  balance  between 
(a)  the  gains  obtained  from  a  reduced  sampling  period,  and  (b)  the  increased  expense  from  a  higher  sampling 
frequency,  are  made.  For  sector  bounded  nonlinearities,  majorant  systems  for  the  state  response  were 
constructed.  When  the  sampling  time  is  much  smaller  than  1,  at  each  time  instant,  these  majorant  systems 
for  5-systems  produce  smaller  state  responses  than  those  corresponding  to  g-systems. 

For  floating  point  arithmetic,  5-systems  produce  smaller  quantization  error  bounds  than  corresponding 
g-systems  only  when  the  nonlinearities  satisfy  certain  magnitude  conditions  relative  to  the  state  vector.  It 
was  shown  that,  these  conditions  are  always  satisfied  if  the  discrete  time  system  is  produced  by  sampling  the 
underlying  continuous  time  system  at  a  very  high  rate.  Note  that,  this  is  in  accordance  with  our  previous 
results  on  sensitivity.  The  underlying  reason  for  these  advantages  of  5-systems  is  due  to  its  implicit  operand 
sorting.  In  other  words,  operands  of  similar  ‘size’  are  grouped  together  in  the  state  equation  of  5-systems, 
whereas,  in  the  g-operator  case,  such  a  grouping  is  not  implicit  and  a  mix  of  operands  of  different  ‘sizes’  is 
created. 

IIL3  Task  3:  2-D  and  m-D  5-System  Models 

In  this  task,  the  5-operator  counterpart  to  the  2-D  Roesser  g-model  was  developed  [13].  It  was  shown  that, 
for  small  sampling  ‘times’  in  both  directions  of  propagation,  the  proposed  2-D  and  m-D  models  possess 
similar  properties  as  the  1-D  model.  For  example,  fixed  point  implementations  are  still  plagued  by  limit 
cycles  and  not  recommended;  however,  floating  point  implementations  can  yield  extremely  attractive  finite 
wordlength  properties. 

The  usual  system  theoretic  notions  such  as  characteristic  equation,  transfer  function,  stability  [14], 
etc.,  have  been  developed  for  the  proposed  2-D  5-models.  Furthermore,  the  notions  of  gramians,  balanced 
realizations,  and  also  its  computation,  were  introduced. 

To  investigate  coefficient  sensitivity  properties  of  the  2-D  5-models,  sensitivity  measures  appropriate 
for  fixed  and  floating  point  arithmetic  schemes  were  developed.  This  analysis  was  carried  out  for  the  more 
general  multi-input,  multi-output  case.  The  resulting  conclusions  may  be  summarized  as  follows: 

1.  In  the  fixed  point  case,  5-models  yield  smaller  coefficient  sensitivity  than  the  corresponding  g-models 
when  the  sampling  ‘times’  are  small.  Balanced  realizations  exhibit  minimum  coefficient  sensitivity.  This 
parallels  the  situation  encountered  in  g-operator  case.  However,  note  that,  generic  limit  cycle  problems 
persist. 
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2.  In  the  floating  point  case,  6-models  consistently  offer  superior  coefficient  sensitivity  when  the  corre¬ 
sponding  g-models’  coefficients  satisfy  certain  mild  conditions.  These  conditions  are  routinely  satisfied 
when  the  implementing  high-Q,  digital  filters  at  high  speeds.  In  most  situations,  2-4  mantissa  bits  of 
an  advantage  is  possible. 

Furthermore,  computation  of  balanced  realizations  has  also  been  addressed.  A  simple  relationship  between 
balanced  forms  of  corresponding  q-  and  6-system  realizations  has  been  established  [13].  This  makes  it  possible 
to  derive  balanced  realizations  using  those  algorithms  that  are  applicable  for  the  ^-operator  case. 
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IV.  Conclusion 

In  summary,  results  obtained  during  the  course  of  this  funding  period  show  that,  6-operator  implementations 
of  discrete  time  systems  can  be  quite  superior  to  their  ^-operator  counterparts  if  they  are  used  correctly.  We 
have  shown  that,  great  gains  can  be  achieved  in  the  case  when  a  continuous  time  system  is  sampled  at  a  very 
high  rate  and  is  implemented  in  floating  point  arithmetic.  Similar  comments  are  applicable  to  nonlinear  and 
m-D  systems  as  well. 

Based  on  this  work,  we  may  make  the  following  conclusion:  6-operator  based  implementations  offer  a 
number  of  unique  and  desirable  properties  which  are  essential  in  high  performance  applications,  such  as, 
high  speed  DSP  and  reliable  simulations  of  dynamical  systems.  For  such  applications  (where  traditional  q- 
operator  based  implementations  are  known  to  be  ill-conditioned),  6-operator  based  schemes  provide  a  general 
and  easily  applicable  technique  for  reliable  implementation  of  discrete  time  systems. 
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PRELIMINARIES 


OPERATORS 

•  For  X  G  3^”*,  g[-]  is  the  operator 

g[x](n)  =  x(n  +  1). 

•  For  X  G  <5[*]  is  the  operator 

x(n  +  l)-x(n)  g(x](n)-x(n) 

«M(n)  = - - = - X - • 

Here,  A  is  a  positive  constant  (usually  the  sampling  time). 

•  5[-]  and  6[*]  are  related  by 

^  =  1  -j-  /S.6. 

q-OPERATOR  based  STATE-SPACE  MODEL 

g-operator  based  model  {Aq,Bq,Cq,Dqy  of  a  linear,  shift- invariant, 

causal,  p-input,  g-output  discrete-time  system: 

g[x](n)  =  AqX(n)  -|-  Rgu(n); 
f-  y(n)  =  C'qX(n)  -f  Dqu{n). 

(5-OPERATOR  BASED  STATE-SPACE  MODEL 
Corresponding  6-operator  based  model  {A^,  C^, 

Intermediate  equation 

6[x](n)  =  A^x(n)  -f-  R6u(n); 
y(n)  =  C6x(n)  -1-  Dsu(n). 

Uvdate  equation 

g[x](n)  =  x(n)  +  A  •  6[x](n). 

•  {Aq,  Bq,  Cq,  Dq}  and  {As,  Bs,  Cs,  Ds)  are  related  by 

Aq  —  I A  AA^J  Bq  —  l!^Bs',  Cq  —  Cs",  Dq  —  Ds> 
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[Tl]  LINEAR,  SHIFT-INVARIANT  DISCRETE-TIME  SYSTEMS 


^OBJECTIVE 

•  How  do  5-systems  perform  under  fast  sampling/ short  wordlength 
conditions?  What  are  their  properties  regarding  limit  cycles, 
quantization  errors,  coefi&cient  sensitivity,  and  dynamic  range? 

^ACCOMPLISHMENTS 

Both  FXP  (fixed-point)  and  FLP  (floating-point)  schemes  are  tackled. 
*LIMIT  CYCLES 

•  FXP  case:  5-systems  (with  small  A)  always  exhibit  limit  cycles. 

•  FLP  case:  Similax  to  g-systems,  with  sufficient  mantissa  length, 
limit  cycles  occur  only  in  underflow. 

^QUANTIZATION  ERROR  PROPAGATION 

•  FXP  case:  5-systems  possess  smaller  bounds  for  quantization 
after  multiplication.  Otherwise,  both  q-  and  5-systems  are  com¬ 
parable. 

•  FLP  case:  In  general,  5-systems  are  better  than  or  equal  to  q- 
systems.  If  5-system  is  the  digital  equivalent  of  a  continuous-time 
system  with  fast  sampling,  it  offers  superior  performance. 

^COEFFICIENT  SENSITIVITY 

•  FXP  case:  5-systems  are  superior  with  fast  sampling. 

•  FLP  case:  In  general,  5-systems  are  better  than  or  equal  to  q- 
systems.  If  5-system  is  the  digital  equivalent  of  a  continuous-time 
system  with  fast  sampling,  it  offers  superior  performance. 

^DYNAMIC  RANGE  CONSTRAINTS 

•  FXP  case:  If  5-system  is  the  digital  equivalent  of  a  continuous¬ 
time  system,  both  q-  and  5-systems  are  comparable.  If  a  g-system 
is  simply  converted  to  a  5-system,  the  latter  requires  a  larger 
dynamic  range. 

•  FLP  case:  If  5-system  is  the  digital  equivalent  of  a  continuous¬ 
time  system,  it  is  superior.  If  a  g-system  is  simply  converted  to 
a  5-system,  the  latter  requires  a  slightly  larger  dynamic  range. 
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LIMIT  CYCLES 

The  ideal  lineax  system  is  tahen  to  be  asymptotically  stable.  We 

consider  the  zero  input  case. 

FXP  Case 

A  6-system  implementation,  under  finite  wordlength,  becomes 

6[x](n)  =  Q{Ajx(n)}; 
g[x](n)  =  x(n)  -1-  Q{A  •  6[x](n)}. 

Here,  Q{*}  is  the  quantization  nonlinearity. 

Accomvlishments 

•  6-systems  exhibit  DC  limit  cycles  if 

A  <  0.5  for  rounding;  A  <  1.0  for  truncation. 

Fundamental  reason  for  these  limit  cycles  is  the  deadzone  of  quan¬ 
tizer.  This  creates  deadbands  for  both  6[x]  and  x. 

•  In  fact,  limit  cycle  free  6-system  implementations  do  not  exist! 

•  A  smaller  sampHng  time  A  yields  a  larger  deadband  for  6[x]. 

•  Construction  of  this  deadband  for  various  arithmetic  schemes 
have  been  performed. 

•  Structure  of  system  matrix  As  has  a  major  effect  on  geometry  of 
deadband  for  x. 

•  Reduction  of  quantizer  deadzone  reduces  size  of  deadband,  thus 
reducing  DC  limit  cycle  amplitude.  But,  this  increases  other 
(oscillatory)  limit  cycles. 

•  Neither  the  use  of  unconventional  quantization  nonlineaxities  nor 
scaling  techniques  overcome  this  difficulty. 

FLP  Case 

Accomvlishments 

•  If  mantissa  length  is  sufficiently  large,  response  will  always  con¬ 
verge  into  underflow. 

•  Hence  limit  cycles  may  occur  only  in  underflow.  This  is  usu¬ 
ally  acceptable  if  dynamic  range  of  underflow  is  sufficiently  small 
(that  is,  smallest  representable  exponent  is  sufficiently  small). 
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QUANTIZATION  ERROR  PROPAGATION 

Quantization  error  propagation  is  investigated  via  error  envelopes. 


FXP  Case 

Accomplishments 

•  Error  envelopes  for  5-systems  are  lower  than  for  corresponding 
g-systems  if  quantization  occurs  after  multiplication.  Otherwise, 
they  are  comparable. 


FLP  Case 

Accomplishments 

•  In  general,  error  envelopes  5-systems  are  better  than  or  equal  to 
^-systems. 

•  However,  when  g-system  matrix  Aq  is  of  the  form 

Aq  =  I  +  {eij}, 

where  the  matrix  elements  satisfy 

I  l«  1, 

5-system  provides  superior  performance.  This  situation  occurs, 
when  a  digital  equivalent  of  a  continuous-time  system  is  obtained 
with  fast  samphng. 

•  In  this  situation,  5-operator  implementation  achieves  ‘operand 
sorting’  (which  is  known  to  tremendously  reduce  quantization 
errors  in  FLP  realizations), 

•  Generalized  versions  of  5-operator,  that  can  tackle  situations 
where  Aq  does  not  satisfy  the  above  condition,  have  been  de¬ 
veloped.  These  provide  superior  performance  than  g-systems. 
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COEFFICIENT  SENSITIVITY 

Coefficient  sensitivity  is  investigated  via  differential  sensitivity  mea¬ 
sures.  Small  perturbations  are  assumed. 

•  Frequency  response  sensitivity  have  been  investigated  by  others. 

•  Time  response  or  orbit  sensitivity  arises  as  a  special  case  of  our 
work  in  Task  [T2]  below. 

FXP  Case 

Accomvlishments 

•  ^-systems  offer  superior  performance,  in  particular,  with  fast 
sampling. 

FLP  Case 

Accomvlishments 

•  In  general,  ^-systems  are  better  than  or  equal  to  the  correspond¬ 
ing  g-systems. 

•  Conditions  under  which  ^-systems  perform  better  are  derived.  In 
particular,  if  the  6-system  is  a  digital  equivalent  of  a  continuous¬ 
time  system  obtained  with  fast  sampling,  it  offers  superior  per¬ 
formance. 


DYNAMIC  RANGE  CONSTRAINTS 
FXP  Case 

Accomvlishments 

•  If  the  6-system  is  obtained  by  discretization  of  a  continuous-time 
system,  the  dynamic  range  requirements  of  corresponding  q-  and 
6-systems  are  comparable. 

•  If  the  6-system  is  obtained  by  simply  converting  a  5-system,  it 
typically  requires  a  larger  dynamic  range,  larger  coefficient  reg¬ 
isters,  and  larger  accumulators. 

FLP  Case 

Accomvlishments 

•  Wordlength  requirements  for  q-  and  6-systems  are  comparable. 

•  If  the  6-system  is  obtained  by  discretization  of  a  continuous-time 
system  with  fast  sampling,  its  zero  convergence  can  be  guaranteed 
with  less  number  of  bits. 


[T2]  DIGITAL  SIMULATION  OF  NONLINEAR  SYSTEMS 


^OBJECTIVE 

•  Can  one  perform  reliable  digital  simulations  of  nonlinear  systems 
using  6-operator  based  numerical  schemes? 

•  If  so,  just  as  for  linear  systems,  would  one  get  superior  fimte 
wordlength  properties? 

•  The  resulting  impact  and  consequences  in  high  performance  com¬ 
puting  (for  example,  in  digital  simulation  of  nonlinear  systems, 
signal  processing,  and  control)  can  be  significant. 


♦ACCOMPLISHMENTS 

Several  important  types  of  nonlinearities  were  considered. 

♦TJMTT  CYCLES 

This  is  quite  similar  to  the  linear  case.  See  our  work  in  Task  [Tl]. 

♦QUANTIZATION  ERROR  PROPAGATION 

•  FXP  case:  Due  to  possibility  of  incorrect  equilibria,  FXP  imple¬ 
mentation  is  not  recommended. 

•  FLP  case:  Conditions  under  which  6-systems  are  superior  are 
derived. 

♦COEFFICIENT  SENSITIVITY 

•  FXP  case:  With  small  grid  size,  6-operator  based  numerical 
schemes  are  superior  than  the  conventional  ^-operator  schemes. 

•  FLP  case:  Conditions  under  which  coefficient  sensitivity  of  6- 
systems  are  superior  are  derived.  Typical  digital  equivalents  of 
nonlinear  systems  under  small  grid  size  routinely  satisfy  these 
conditions. 

♦DYNAMIC  RANGE  CONSTRAINTS 

This  is  quite  similar  to  the  linear  case.  See  our  work  in  Task  [Tl]. 
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-OPERATOR  BASED  NONLINEAR  SYSTEM 

g[x](n)  =  f<j(x(n),aq). 

•  aq  =  [ai^, . .  •  the  coefficients  that  axe  actually  stored 

in  computer. 

<^-OPERATOR.  BASED  NONLINEAR  SYSTEM 
We  propose  the  following: 

Intermediate  epuation 


<5[x](n)  =  f^(x(n),a5). 


Uvdate  equation 


g[x](n)  =  x(n)  A  •  <5[x](n). 

•  (5[x](n)  =  (g[x](n)  -  x(n))/A  and  =  (fg  -  x)/A.- 

•  A  is  an  arbitrary  positive  constant  (usually  the  grid  size). 

•  =  [a^i ,  •  •  • ,  (^SmV  coefficients  that  are  actually  stored. 

QUANTIZATION  ERROR  PROPAGATION 

FXP  Case 

Accomylishments 

•  (5-systems  offer  superior  performance  if  quantization  is  performed 
after  multiplication  or  if  polynomial  nonlinearities  of  higher  order 
are  to  be  implemented. 

•  However,  in  FXP,  <5-systems  may  converge  to  incorrect  equilib¬ 
ria  (see  comments  in  [Tl]).  Hence,  FXP  implementation  is  not 
recommended. 

FLP  Case 

Accomylishments 

•  6-systems  show  significantly  reduced  quantization  error  bounds 
if  6[x](n)  =  f5(x(n))  where  [[A  •  f^(x(n))||  «  I|x(n)l|. 

•  Un(ier  fast  sampling,  similar  to  the  linear  case,  this  condition 
is  routinely  satsified.  Hence,  6-operator  based  discretization 
schemes,  in  FLP,  can  drastically  reduce  quantizations  errors  with 
fast  sampling. 
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COEFFICIENT  SENSITIVITY 

For  this  presentation,  the  nonlinearity  is  taken  to  belong  to  that  is, 
it  possesses  first  partial  derivatives.  Small  perturbations  are  assumed. 


FXP  Case 

Coefficient  perturbation  is  approximately  independent  of  its  nominal 
value.  Hence,  a  good  sensitivity  measure  of  orbit  x  is  ^/^ajn  = 
5x(n)/5a. 

Accomvlishments 

•  Comparison  of  q-  and  6-systems:  d'x.fdB.q\n  —  ^  ’  ^x/^a^l^. 
Hence,  6-operator  based  schemes  offer  superior  coefficient  sen¬ 
sitivity  when  A  is  small. 

•  Similar  comments  hold  true  for  linear  systems,  piecewise  non¬ 
linear  systems,  and  piecewise  linear  systems. 


FLP  Case 

Coefficient  perturbation  is  approximately  proportional  to  its  nominal 
value.  Hence,  a  good  sensitivity  measure  of  orbit  x  is 

1 


Accomvlishments 

•  Comparison  of  q-  and  6-systems:  We  have  shown  that,  6-operator 
based  schemes  offer  superior  coefficient  sensitivity  if 

1]  —  1^*9  1»  Vi  “  1,  .  .  .  771. 

Here,  indicates  the  ‘linear’  term  in  the  i-th  equation  of  f^. 

•  Similar  comments  hold  true  for  hnear  systems,  piecewise  non- 
Hnear  systems,  and  piecewise  linear  systems. 
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F/vample:  Lorenz  Equation 

Consider  the  digital  simulation  of  Lorenz  equation: 

+  ^122^2(05 

~  +  0,22^2{f)  +  02132^1(^)2^3(05 

~  033X3(0  +  03122:1  (i)x2(0* 

Here,  an  =  -a,  a^  =  o’,  021  =  />,  022  =  -1,  0213  =  -1?  033  = 
and  0312  =  !• 

q-overator  based  forward  Euler  scheme  with  A  =  le  —  04 
9[2?iJ(^)  =  Oii,xi,(n)  +  012,2:2,  (n); 

9[2^2,](o)  =  021,2:1,  (n)  +  022,2:2,(0)  +  0213,2:1,  (n)x3^(n); 
9[^3,](o)  =  033^X3,  (n)  +  a3i2,2:i,X2,(n). 

Here,  on,  =  1— Ao,  012,  =  Aa,  021,  =  Ap,  022,  =  1— 0213,  = 

033,  =  1  -  and  0312,  =  A. 

8-overator  based  forward  Euler  scheme  with  A  =  le  —  04 

^[2^i«l(^)  =  OmXig(n)  +  01242:24(0); 

^[^26](o)  =  02i4Xij(n)  +  02242:24(0)  +  021342:14  (o)x3^(n); 
^[2:3,](o)  =  033^X3^(71)  +  031242:14X24(0). 

Here,  0114  =  on,  0124  =  012,  0214  =  021,  0224  =  022,  02134  =  0213? 
0334  =  033,  and  03124  =  0312. 


Simulation  data 

•  Nominal  coefficient  values:  o  =  10;  /)  =  28;  /3  =  8/3.  This  system 
exhibits  chaotic  behavior. 

•  Initial  conditions:  Xg(0)  =  x^(0)  =  [0,5,75]^. 

•  Data  type:  Two  simulations  were  implemented  in  C  using  both 
FLOAT  (32-bit  FLP)  and  DOUBLE  (64-bit  FLP)  data  types. 

•  Comparison:  DOUBLE  simulations  xmtil  8  s  (where  both  q-  and 
6-  DOUBLE  schemes  are  identical)  were  taken  as  a  benchmark 
for  comparison  of  FLOAT  simulations.  Clearly,  the  computed 
orbit  from  the  5-scheme  is  more  reliable  for  a  longer  duration! 
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n™  responsa  of  Mall  2:  x2  (DOUBLE);  x2q  (FLOAT);  x2d  (FLOAT) 


Tima.  a.  Slop  Mia.io-oa  Tima.  $.  Slap  ilia.ta04 


[T3]  2-D  AND  m-D  DISCRETE-TIME  SYSTEMS 


^OBJECTIVE 

•  Do  the  superior  finite  wordlength  properties  hold  true  if  2-D  and 
m-D  discrete- time  systems  are  implemented  using  ^-operator? 

•  If  so,  such  implementations  are  useful  in  high  performance,  real¬ 
time  applications  that  use  fast  sampling/short  wordlength. 

^ACCOMPLISHMENTS 

^FUNDAMENTAL  SYSTEM  THEORETIC  CONCEPTS 

•  5-operator  analog  of  the  2-D  Roesser  ^-model. 

•  Notions  of  characteristic  equation,  transfer  function,  stability, 
etc.,  have  been  developed. 

•  Algorithm  to  check  stability,  notions  of  gramians  and  balanced 
realizations  have  been  developed. 

^COEFFICIENT  SENSITIVITY 

•  FXP  case:  Balanced  realizations  possess  ‘minimum’  coefficient 
sensitivity. 

•  FLP  case:  Conditions  under  which  5-systems  perform  better  are 
derived.  Typically,  narrowband  high  speed  digital  filters  satisfy 
these  requirements. 

FUNDAMENTAL  SYSTEM  THEORETIC  CONCEPTS 

Operators 

•  Define  operators  qh[-]  and  gv[*]  as 

g/i[x](2,i)  =  x(i  +  IJ)  and  gT;[x](i,i)  =  x(2,  j  -i- 1). 

•  Propose  operators  5/i[-]  and  5„[-]  as 

=  - T - ■ 

Here,  A/i  and  A^,  axe  positive  constants  (that  are  the  counterparts 
of  samphng  time). 


11 


g-Oerator  Based  Roesser  Model 

^-operator  based  Roesser  model  {Aq^Bq^Cq^Dq}  of  a  linear,  shift- 
invariant,  strictly  causal,  p-input,  g-output  2-D  discrete-time  system: 


+  [-Bqlu(2,i); 


y{hj)  =  [dq^'^  “*■ 


+  lDq]u(i,j). 


^-Operator  Based  Roesser  Model 

We  propose  the  following  ^-operator  based  Roesser  model: 
Intermediate  equation 


'6h[y:^]{ijy 

+ 

1 - 

e 

L-Bf  J 

-  U.1 

+  [BsMiJ); 

cf>] 


+  [DsMhj) 


x^(ij) 


+  [DsMiJ)- 


Uydate  equation 

Qh[3C^](i,j)  =  +  Ak  •  (5;,[x'‘](2,i); 

=  x^(i,i)  -i-  A„  •  (5„[x^(z,i). 

*  ^qi  Dq}  and  {A5,jB^,  C^,Z)^}  are  related  by 

Aq  =  lA  tAs;  Bq  =  tBs;  Cq  =  C^;  Dq  =  Ds. 

Here,  r  =  [A hi  0  A„/]. 
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Gramians 

Analogous  to  the  1-D  and  2-D  g-operator  cases,  reachability  and  ob¬ 
servability  gramian  axe  proposed  as: 


P  = 


p(2)-| 

p(4)J 

Q(4)J 


1  /  pj..  dcH  dc,  , 

(27rj)2  1  A/iC/v  1  -H  AyCv  ’ 

6 

1  /  Q*Q  _ 

(27rj)2  Jq-7  1  -b  A/iC/i  1  -b  AvC„ 

6 


Here,  F(ch,Cv)  =  {I  -  As)  ^Bs  and  G{ch,Cv)  =  Csil  —  As) 
denotes  stability  boundary. 


Balanced  Realizations 

It  is  proposed  to  call  {As^Bs^CsiDs}  balanced  if 
p(i)  =  =  diag{cT^^\  . . . , 

p(4)  ^  q{4)  ^  diag{cr[^\  . . . , 


Accomvlishments 

•  Characteristic  equation  and  transfer  function,  relationship  with 
g-model,  equivalent  transformations,  algorithm  to  check  stability, 
etc.,  are  developed. 

•  Computation  of  gramians  is  addressed.  For  separable  systems, 
they  are  block  diagonal  and  may  be  computed  via  solution  of 
four  Lyapunov  equations. 
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COEFFICIENT  SENSITIVITY 

Coefficient  sensitivity  of  proposed  model  is  investigated  via  suitable 
differential  sensitivity  measures.  Small  perturbations  are  assumed. 


FXP  Case 

Coefficient  perturbation  is  approximately  independent  of  its  nominal 
value.  Hence,  define 

Mfxp  =  \\Sas\\i  +  +  -Il'S'csIli  + 

Here,  Sas  =  dHs/dAs,  etc.  Hs  is  the  transfer  function. 
Accomylishments 

•  Realizations  that  axe  bound  optimal  with  respect  to  Mpxp 
in  fact  balanced. 

•  When  A/i  <  1  and  <  1,  that  is,  with  fast  ‘sampling’,  balanced 
5-model  is  better  than  its  corresponding  g-model. 


FLP  Case 

Coefficient  perturbation  is  approximately  proportional  to  its  nominal 
value.  Hence,  define 


Mflp  =  115a.  II?  +  ^||5b.||1  +  i||5c.|ll  +  ^II^d.III- 

p  q  pq 

Here,  Sas  —  ^  ^  y  ] / ddi-iA ^  etc. 

Accomylishments 

•  Realization  that  are  bound  optimal  with  respect  to  Mflp  are 
better  than  its  corresponding  g-model  if 

11^9  ~  -^IIf  < 

•  High  speed  narrowband  digital  filters  typically  satisfy  this  re¬ 
quirement. 
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Example:  Narrowband  5h-5v  2-D  separable  digital  filter 

The  corresponding  g-Roesser  model  and  transfer  function  axe  denoted 

as  {Aq^Bq,Cq^Dq\  and  Hq(zh,  z^),  respectively. 

•  Let  {Aq^  Bq^Cq^  Dq}  denote  the  corresponding  balanced  q- 
system.  Under  finite  wordlength,  let  the  transfer  function  be 

Zv)’ 

•  Let  {As^Bs^Cs^Ds}  denote  the  corresponding  balanced  6- 
system.  Under  finite  wordlength,  let  the  transfer  function  be 

(^C}i ,  Cy ) . 

Simulation  Data 

•  Mantissa  length:  Hq  and  were  implemented  with  different 
mantissa  lengths  (for  the  coefficients)  to  see  the  effects  of  coeffi¬ 
cient  sensitivity. 

•  Plot  shows  log[£7inax]  versus  mantissa  length.  Here,  log[E'niax]  = 
\Hq  -  Hq\  (for  the  g-system)  or  log[Emax]  =  1^,5  -  Hq\  (for  the 
d-system).  Hq  is  implemented  with  ‘infinite’  wordlength. 

•  Clearly,  balanced  <5-system  performs  better  than  the  balanced 
^-system  (which  is  ‘optimal’  with  respect  to  the  5-system  coun¬ 
terpart  of  sensitivity  measure  Mpxp)! 
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COMPARISON  OF  IMPLEMENTATIONS 


FXP  CASE 

FLP  CASE 

Quantization  error  bounds 
General  system 

5-systems  mostly  superior 

5-systems  better  than  or 
equal  to  ^-systems 

Quantization  eiTor  bounds 
Digital  equivalent  of 
continuous-time  system 
with  short  sampling  time 

5-systems  mostly  superior 

5-systems  superior 

Limit  cycles 

5-systems  exhibit  limit 
cycles 

q-  and  5-systems  both 
exhibit  limit  cycles  only 
in  underflow 

Dynamic  raiiije  constraints 

5-systems  more  likely  to 

Unlikely  in  both  q-  and 

Register  overflow 

cause  overflow 

5-systems 

Coefficient  sensitivity 
General  system 

5-systems  superior 

5-systems  better  than  or 
equal  to  ^-systems 

Coefficient  sensitivity 
Digital  equivalent  of 
continuous-time  system 
with  short  sampling  time 

5-systems  superior 

5-systems  superior 

Hardware  requirements 

5-systems  require  longer 

q-  and  5-systems 

Implementation  of  5'‘ 
requires  additional  sum 
and  product 

registers  (for  both 
coefficients  and  signals) 

comparable 

PROJECT  TITLE: 

High-speed  fixed-  and  fioating-point  implementation  of  delta-operator  formu¬ 
lated  discrete-time  systems 
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SUMMARY  OF  PHASE  P2  RESULTS 

The  work  described  in  this  report  is  related  to  the  following 
[T2]  Task  T2:  Analysis  of  nonlinear  circuits  through  6-operator  based  schemes. 
Problems  Posed  in  Task  T2; 

Regarding  the  proposals  associated  with  the  above  grants,  within  Task  T2,  the  following 
questions  were  raised: 

1.  With  the  desirable  properties  of  6-systems  applicable  to  linear  systems  in  mind,  does 
the  same  carry  over  if  nonlinear  systems  are  implemented  with  6-operator  based 
schemes? 

2.  In  particular,  issues  concerning  coefficient  sensitivity  and  quantization  noise  is  of  spe¬ 
cial  importance  in  such  systems. 

3.  If  a  6-operator  based  scheme  offers  significant  improvements  over  its  g-operator  coun¬ 
terpart,  the  consequences  in  nonlinear  signal  processing,  nonlinear  control,  and  digital 
simulation  of  nonlinear  dynamics  can  be  significant.  . 

In  fact,  the  superior  finite  wordlength  performance  of  the  discrete  simulation  of  Chua’s 
Circuit  in  the  grant  proposals  using  the  6-operator,  instead  of  the  more  conventional  q- 
operator,  provided  the  impetus  for  the  work  proposed  in  Task  T2.  The  work  described 
herein  justifies  our  preliminary  optimism  and  show  that  this  superior  performance  can  be 
expected  with  6-operator  based  implementations. 
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This  task  was  proposed  to  be  carried  out  during  Phase  P2  with  close  collaboration 
between  the  two  Pi’s.  During  the  whole  project  duration,  both  Pi’s  have  been  in  con¬ 
stant  contact.  In  particular,  a  considerable  portion  of  the  work  described  herein  was  seen 
to  maturity  during  a  one-week  research  stay  at  University  of  Notre  Dame  during  August 
09-16,  1994.  During  this  time,  important  results  that  address  coefficient  sensitivity  and 
quantization  error  bounds  applicable  to  5-operator  based  implementation  of  nonlinear  sys¬ 
tems  were  developed.  A  description  of  those  Phase  P2  results  pertaining  to  coefficient 
sensitivity  follows. 

Task  T2;  Results  Pertaining  to  Coefficient  Sensitivity — Summary 
Briefly,  conclusions  drawn  from  this  work  may  be  summarized  as  follows:  We  have  investi¬ 
gated  orbits  of  linear  and  nonlinear  systems.  Several  important  types  of  nonlinearities — 
nonlinearities,  piecewise  nonlinearities,  and  piecewise  linear — were  looked  into. 

•  The  Fixed-Point  Arithmetic  (FXP)  Case: 

With  small  step,  size,  5-systems  provide  superior  coefficient  sensitivity  performance. 

•  The  Floating-Point  Arithmetic  (FLP)  Case: 

Conditions  under  which  5-systems  provide  superior  coefficient  sensitivity  were  derived. 
Typical  digital  equivalents  of  nonlinear  systems  derived  for  simulation  purposes  in  fact 
routinely  satisfy  these  conditions  when  the  step  size  is  small. 


2 


Task  T2;  Results  Pertaining  to  Coefficient  Sensitivity — Brief  Description 
Consider  the  following  5-operator  based  implementation  of  a  nonlinear  system: 


5[x](n)  =  f,(x(n),ag), 


(1) 


where  ^[x]  =  x(n  -f-  1).  Here,  x(n)  is  the  state  x  €  at  time  instant  n  and  a^  = 
[ogj , . . . ,  refers  to  the  system  parameters  that  are  actually  stored  within  the 

computer. 

The  corresponding  ^-operator  based  scheme  of  the  same  nonlinear  system  is  of  the 


form 

^[x](n)  =  f5(x(n),  aj)  (Intermediate  equation) 
5[x](n)  =  x(n)  -|-  A  •  5[x](n)  (Update  equation) 
where  ^[x](n)  =  (5[x](n)  —  x(n))/A  and 


(2) 


(3) 


Here,  A  G  3?  is  an  arbitrary  positive  real  parameter  and  as  =  [a^i, . . . ,  as  mV  ^  again 
refers  to  the  system  parameters  that  are  actually  stored  within  the  computer. 


To  see  the  relationship  between  a,  and  a^,  let  the  i-th  equation  in  (1)  be 
5[xi](n)  =  fgX^i{n),...,Xm(n),ag^,...,aq^),  i  = 

Then,  we  may  encounter  one  of  two  situations: 


(4) 


1.  There  is  a  linear  term  corresponding  to  that  is,  a  term  of  the  nature  aKXi(n),  on 
the  RHS  of  (4).  Then,  we  need  to  store 


_  fori  =  {l,...,M}\A'; 

asi  iovi  =  K. 


(5) 


2.  There  is  no  linear  term  corresponding  to  r,-  on  the  RHS  of  (4).  Then,  we  need  to  store 
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Ci,.  =  ^,  for  z  =  {!,...,  M},  and 


(6) 


Remark. 

1.  Of  course,  in  an  infinite  wordlength  implementation,  there  simply  is  no  difference 
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between  the  q-  and  ^-operator  based  schemes  in  (1)  and  (2).  In  fact,  the  latter  requires 
a  modest  increase  in  the  number  of  computations.  However,  what  we  address  is  the 
performance  under  finite  wordlength  high-speed  conditions. 

2.  Discretization  of  a  nonlinear  system  of  the  form 

xl'>(()=f(x(t).a)  (7) 

can  give  rise  to  equations  of  the  type  in  (1)  and  (2).  Here,  is  the  i-th  derivative  of  x. 

3.  In  what  follows,  f(x,  a)  €  denotes  a  nonlinear  fimction  that  possesses  first  partial 
derivatives. 

Now,  which  of  the  schemes  (1)  or  (2)  yield  superior  coefficient  sensitivity  properties 
of  its  orbit  with  respect  to  perturbations  of  or  a^,  respectively?  This  consideration  is 
crucial  in  high-speed  applications  where  a  shorter  wordlength  is  the  avenue  of  choice. 

In  what  follows,  the  following  standing  assumptions  are  made: 

1.  All  perturbations  are  small. 

2.  Comparison  between  q-  and  ^-operator  based  implementations  are  done  with  respect 
to  upper  bounds  (constructed  through  appropriate  norms)  on  possible  errors  due  to 
coefficient  sensitivity. 
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FXP  CASE 

In  the  FXP  case,  a  good  indication  of  the  coefficient  sensitivity  of  the  orbit  x  is  its  first 
partial  derivative  with  respect  to  the  stored  coefficient  vector  a,  that  is, 


5x 

Bb. 


=  ^x(n)  e 
aa 


(8) 


1.  nonlinear  system 


q-operator  case 

For  this  case,  we  can  show  the  following 


Theorem  1.  For  the  ^-operator  based  implementation  in  (1), 


5x 


da.a 


n+l 


n— 1  /  n 

n  ■■■ 


dXm 


] 


j=Q  \  i=j  +  l 

where  Im  denotes  the  identity  matrix  of  size  M  x  M  and 


dfg 

da„ 


+ 


dfg 

dSia 


C 

L  dxx 


^Xrr^ 


]  .  ~  (  axi  ^9(0 


axn,"9 


fg{i)]e^ 


TTiXm, 


da-a 


da, 


mM 


8-operator  case 

For  brevity,  we  only  consider  the  case  in  (5).  Note  that. 


dx 

das 


n 


5x 

dag 


•A. 

n 


(9) 


In  addition,  we  need  to  consider  the  sensitivity  of  the  orbit  with  respect  to  A  (due  to  the 
update  equation  in  (2)).  However,  if  we  assume  an  exact  FXP  representation  for  A,  this 
term  could  be  ignored. 


Using,  for  instance,  a  norm  to  compare  the  sensitivity  measures,  we  conclude  that,  the 
5-operator  based  implementation  will  provide  superior  coefficient  sensitivity  performance. 


Remark.  We  obtain  similar  results  when  considering  the  case  in  (6).  Here,  one  may  need 
to  consider  sensitivity  with  respect  to  1/A  eis  well.  Again,  we  may  assume  that  1/A  (and 
A)  have  exact  FXP  representations.  Even  if  this  is  not  the  case,  5-system  is  still  likely  to 
be  superior  since  the  reduction  in  sensitivity  gained  through  other  terms  is  A-fold. 
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II.  Linear  system. 

The  superior  coefficient  sensitivity  of  the  frequency  response  of  ^-operator  based  systems 
is  thoroughly  investigated  in  Li  and  Gevers  (1990).  However,  no  result  exists  that  address 
the  coefficient  sensitivity  of  the  orbit 


q-operator  case 

With  the  more  general  result  in  Theorem  1,  we  can  show  the  following 


Theorem  2.  For  the  ^-operator  based  implementation  x(n  +  1)  =  Agx(n),  Aq  6 

n~l 


^x 

dAa 


n+1 


—  ^  ](-^m  ®  -^q  TnXmi^Im  ®  x)  A  U ®  x) 


i=0 


6  SR'f'xp' 


ri(9Xp)  _  p(9)p(p) 

,  i^i-  -  e-  e- 


where  U q^p  =  E\ 

e|”^  6  3?”  is  the  unit  vector  with  1  on  its  i-th  row  (Brewer  1978). 


G  Here, 


6-operator  case 

The  corresponding  ^-system’s  intermediate  equation  is  ^[x](n)  =  As:x.{n)  where  As  = 
[Aq  —  I)/ A.  The  update  equation  of  course  is  as  in  (2). 


Again,  as  in  Section  I,  we  can  show  that,  the  ^-operator  based  implementation  will 
provide  superior  coefficient  sensitivity  performance. 


III.  Piecewise  nonlinear  system 

Consider  a  nonlinearity  that  is  piecewise  and  possesses  first  partial  derivatives  within  each 
‘piece’.  To  address  its  coefficient  sensitivity,  we  model  the  dynamics  of  such  a  system  as 
follows: 


1.  Within  each  ‘piece’,  the  system  dynamics  is  a  nonlinearity. 

2.  Each  instant  of  the  orbit’s  ‘entry’  into  another  ‘piece’  is  modeled  as  a  perturbation  in 
the  initial  conditions. 


Regarding  item  1,  as  previous  results  indicate,  the  6-operator  based  implementation 
will  be  superior  within  each  ‘piece’.  Regarding  item  2,  we  need  to  investigate  the  orbit’s 
coefficient  sensitivity  with  respect  to  initial  conditions.  This  is  addressed  now. 


q-operator  case 

A  reasonable  sensitivity  measure  is 

dx 


dx{0) 


n 


d 

dx{0) 


x(n)  € 


(10) 
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Then,  we  can  show  the  following 

Theorem  3.  For  the  ^-operator  based  implementation  in  (1), 


dx 


5x(0) 


n+l 


=  -fm  <8)  n  [ 


3f, 

dxi 


i=0 


'iU”) 


8-operator  case 

One  may  show  that,  Theorem  3  is  equally  applicable  for  the  5-operator  case  as  well. 

Hence,  regarding  sensitivity  due  to  initial  conditions,  both  q-  and  5-operator  based 
implementations  are  expected  to  be  provide  comparable  results. 

This  implies  that,  in  totality,  5-operator  based  implementations  will  provide  superior 
results. 

IV.  Piecewise  linear  system 

Again,  we  address  the  coefficient  sensitivity  of  the  orbit  with  respect  to  the  initial  condi¬ 
tions. 


q-operator  case 

As  in  Section  II,  with  the  more  general  result  in  Theorem  3,  we  can  show  the  following 


Theorem  4.  For  the  ^-operator  based  implementation  of  x(n  -t-  1)  =  Agx(n), 

dx 


dx(0) 


n+l 


=  o-ec  A 


6 -operator  case 

Again,  one  may  show  that,  Theorem  4  is  equally  applicable  for  the  5-operator  case  as  well. 

Hence,  as  in  Section  III,  5-operator  based  implementations  will  provide  superior  re- 

« 

suits. 
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FLP  CASE 

In  the  FLP  case,  representable  values  axe  spaced  farther  apart  at  higher  values  of  the  pa¬ 
rameter.  Hence,  instead  of  that  used  for  the  FXP  case  (see  (8)),  a  more  realistic  sensitivity- 
measure  is  (see  Li  and  Gevers  (1990)) 


dx 

5a/a 


n 


r  1 


_ 2 _ 

^  daM/a-M 


x(n)J 


(11) 


I.  nonlinear  system 


q-operator  case 

For  this  case,  we  can  show  the  following 


Theorem  5.  For  the  ^-operator  based  implementation  in  (1), 


dx 

dag/ag 


n-l 


ilk 

dxi 


i=j+l 


dig 

dag/ag 


+ 


5L 


dag/ag 


n 


S-operator  case 

Again,  we  only  consider  the  case  in  (5).  Also,  let  us  assume  that,  the  elements  in  a,  are 
enumerated  such  that,  for  each  z  =  1, . . .  ,m,  a,-  is  the  ‘linear’  element  of  the  z-th  equation. 


Then,  note  that. 


dx 


das /as 


an  "I 

das^ 


dx. 

(Ogi  -  1) 


9x  -\ 


da 


(a?m  -  1) 


dx 


CL 


daq 

dx 


9m+i  da 


9m  +  l 


_ dx 

da 


where  we  have  used  (5)  and  (9).  As  before,  we  may  ignore  the  effect  of  A. 


(12) 


Again,  we  use  a  norm  to  compare  the  sensitivity  measures.  For  instance,  using  the  1- 
or  oo-norm,  we  conclude  that,  the  ^-operator  based  implementation  will  provide  superior 
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coefficient  sensitivity  performance  if 

Ki  -  1|  ^ 

But,  how  practical  is  this  restriction?  In  other  words,  how  often,  if  at  all,  is  it  satisfied 
in  practice?  To  address  this,  consider  the  following 

Example.  Lorenz  equation.  Consider  the  state-space  description  of  the  Lorenz  equation; 

~  ^2{t)y, 

=  pa;i(t)  -  X2it)  -  Xi(i)x3(t); 

=  Xi(t)x2(i)  -  0X3(t). 

For  digital  simulation  of  the  corresponding  orbit,  we  use  the  forward  Euler  scheme  with 
step  size  A.  This  yields 

Xi(n  -t- 1)  =  (1  -  Act)  Xi(n)  -|-  Act  X2(n); 

X2(n  +  1)  =  Apxi(n)  +  (1  -  A)x2(n)  -  Axi(n)x3(n); 

X3(n  -[- 1)  =  (1  -  A^)x3(n)  +  Axi(n)x2(n). 

We  at  once  observe  the  following;  For  a  small  step  size  A, 

1.  Linear  terms  are  close  to  1. 

2.  Other  terms  are  very  small. 

Hence,  the  condition  in  (13)  is  in  fact  satisfied! 

In  fact,  when  digital  simulation  of  nonlinear  systems  are  carried  out,  (13)  is  often 
satisfied  for  a  small  step  size  (which  denotes  fast  sampling).  Hence,  we  conclude  that, 
a  ^-operator  based  implementation  of  such  a  simulation  will  provide  superior  coefficient 
sensitivity  performance!! 

II.  Linear  system 

Again,  no  result  that  addresses  coefficient  sensitivity  of  the  orbit  of  linear  systems  imple¬ 
mented  using  FLP  arithmetic  is  available. 

Without  delving  into  much  detail,  we  simply  state  the  relevant  result:  Consider  the 
g-operator  based  implementation  x(n  -b  1)  =  A,x(n)  and  its  corresponding  ^-operator 
based  implementation.  With  respect  to  the  FLP  coefficient  sensitivity  measure  introduced 
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above,  the  coefficient  sensitivity  of  the  ^-system  is  superior  (in  terms  of  the  norm  being 
used)  than  that  for  the  corresponding  (|r-system  if 

ll>i,  -  111  <  m,ll-  (1^) 

It  is  not  hard  to  show  the  following: 

|Ai[A5]  -  1|  <  lA^Agll,  Vz  =  ||A,  -  J||f  <  1|A,||f;  (15a) 

|Ai[A5]  -  1|  <  |Aj[Ag]|,  Vz,i  =  llA,  -  JII2  <  IIA5II2.  (15b) 

IdiagJA,]  -  1|  <  IdiagjA,]!,  Vz  =  l,...,m  ||Ag  -  J||i,oo  <  ll^glli.oo-  (15c) 

Here,  Ai[Ag]  denotes  the  i-th  eigenvalue  of  Aq  and  diagjAg]  denotes  the  z-th  diagonal 
element  of  Aq. 

Hence,  if  any  one  of  the  above  conditions  are  satisfied,  the  5-operator  based  imple¬ 
mentation  will  provide  superior  coefficient  sensitivity  performance. 

Remark.  Li  and  Gevers  (1993)  refers  to  the  region  in  condition  (15a)  as  the  Middleton- 
Goodwin  (MG)  Region.  They  have  shown  that,  if  (15a)  is  satisfied,  the  5-operator  based 
implementation  will  provide  superior  coefficient  sensitivity  of  its  frequency  response. 

Regarding  systems  corresponding  to  those  in  Sections  III  and  IV  of  the  FXP  case,  5-systems 
offer  similar  advantages. 

Example,  continued.  Lorenz  equation.  To  justify  and  validate  the  results  above,  a  digital 
simulation  of  the  Lorenz  equation  was  carried  out  using  both  q-  and  5-operator  schemes 
with  FLP.  The  results  are  summarized  in  the  series  of  graphs. 

1.  Nominal  coefficient  values:  cr  =  10;  p  =  28;  ^  =  8/3. 

2.  Initial  conditions:  [a:i(0), X2(0), X3(0)]^  =  [0, 5, 75]^. 

3.  Coefficient  representation:  FLP  arithmetic  with  the  number  of  bits  used  for  the  man¬ 
tissa  indicated  on  each  graph. 

4.  Integration  scheme:  Forward  Euler  with  step  size  A  =  le  —  03. 

5.  Number  of  time  steps  is  25,000. 

6.  Only  projection  onto  (xi,X2)-plaiie  is  shown. 
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It  is  important  to  note  that,  when  only  4  bits  are  allowed  on  the  mantissa,  the  qualitative 
behavior  of  the  5-system  is  completely  different  than  what  is  expected.  Hoever,  the  S- 
system  still  provides  satisfactory  results.  Hence,  one  may  use  a  shorter  wordlength  for 
coefficient  representation  with  the  latter  without  affecting  performance.  The  implications 
on  speed,  number  of  components,  cost,  reliability,  etc.,  are  obvious. 
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HIGH  SPEED  FIXED-  AND  FLOATING-POINT 
IMPLEMENTATION  OF  DELTA-OPERATOR 
FORMULATED  DISCRETE-TIME  SYSTEMS 


Peter  H.  Bauer  and  Kamal  Premaratne 


Focus:  Effects  of  Quantization  Errors  in  Nonlinear 
Q-  and  A- Operator  Systems 


Abstract 

Absolute  quantization  error  bounds  are  constructed 
for  q-  and  ^-operator  implementations  of  the  nonlin¬ 
ear  system  Xn^i  =  f{xn)>  Various  assumptions  on  the 
type  of  the  nonlinearity  /(♦)  are  made  and  both  fixed 
and  floating  point  formats  are  investigated.  A  compar¬ 
ison  between  the  advantages  and  disadvantages  of  the 
two  implementation  schemes  is  introduced.  Finally,  an 
outlook  concerning  future  work  is  given. 
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I.  Absolute  Bounds  on  Quantization  Errors 

1.1.  Nonlinearities  of  the  Polynomial  Type 

1.1.1.  Fixed  Point  Case 


Q-operator  case: 

•  System  description: 

.  £™+i=/(xn), 

where 


/fen)  = 


V 

Ni 


/Affel?  •  * 


’  *  *  5  ■ 

j  = 


Xjy- 


•  Assumptions: 

-  single  precision  (i.e.,  single  length  accumulators) 

-  quantization  step:  q 


•  Computed  Orbit: 

x{n) 
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•  Error  model  for  the  computed  orbit: 


Nj 

E 

11=0 


Nj 

E 

*jW=0 


a 


ij)  . 

1 


1  II  . 

'Xm  +Mj 


where 


ixj = X]  s  4^^  ^ ^  s 

i  z  i 


(M-Nj) 

^ji 


and 


leJPl  <  kq  (truncation) 
1 4;' I  ^  ^9  (rounding) 


•  If  the  nonlinearity  /j(  )  is  known,  the  number 
of  nonzero  terms  in  the  polynomial  is  known 
and  therefore  the  number  of  terms  in  the 
summations  of  e-terms.  Hence  an  absolute 
bound  on  /ij  can  be  constructed: 

1/ijl  <  Cjq  (truncation) 


where  Cj  —  li  +  2I2  -\ - 1-  M  •  NjIm-Nj 

being  the  number  of  terms 
present  in  the  summation  Ej 
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6 -operator  case: 

•  system  description: 


8x(ri) 

8xj{n) 


f{xn)  -  Xn 


A 


,  x(n  +  1)  =  x(n)  +  A^[x(n)]. 


N, 


E 

21=0 


"j  o(-'>  •  ■ 

E 


Nj 


N, 


y  ...  y  .  xi 

*1=0  *M=0 


n 


■4-2 


Xm 


where 


b) 


(i) 


*l5— )*Af 


a 


U) 

for  s.t/i. 

=  1,  and  ijy  =  0  for 

,0-) . 

otherwise  . 


•  Assumptions  (same  as  in  ^-operator  case): 

-  single  precision 

-  quantization  step:  q 

•  Computed  Orbit: 

x{n) 
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•  Error  model  for  the  computed  orbit: 


=  E  •  ■  •  ,  E  .  . 


il=0 


where 


Mr'  =  ?  +  E  mJ?  +  •  ■  •  +  E 


,(^)  _  ..(1) 

^  t 


and 


<  /c  •  g  (truncation) 
iMji"’!  <  ^  •  9  (rounding) 


•  Upper  bound  on 

^  {Cj  +  1) '  q  worst  case 
where  Cj  is  defined  as  in  the  g-operator  case. 

•  Error  in  the  computation  of  the  next  state: 


Xj{n  +  1)  =  Xj{n) A6[xj{n)]  =  E  E 

*1=0  *iW=0 

+  A  ■  ixf\n)  + 

where 

|/^a](^)1  <  Q  truncation 

^  I  rounding 
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Comparison:  6-  vs.  q-operator: 

Error  term  bound  for  the  g-operator: 

IfJ'jl  Cj  '  q  (truncation) 

Error  term  bound  for  the  ^-operator: 

\A^lj!f^+pl]\  <  {Cj  +  l)qA+q  =  q{[Cj-\-l]A-\-l)  (truncation) 

•  ^-operator  formulation  has  a  smaller  absolute 
error  bound  for: 

^  ,  I  >  A,  for  j  =  1,  •  •  •  ,M 

O  j  +  i 

Usually  Cj  »  1  and  hence  for 

1  —  €  >  A, 

the  ^-operator  system  is  preferable. 

(For  high  speed  systems  we  typically  have  A  <<  1.) 
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Reasonable  choice  of  A  (from  an  error  bound  per¬ 
spective): 


Remarks: 

•  ^-operator  implementations  in  FXP  format 
seem  to  produce  a  significantly  smaller 
bound  than  g-operator  implementations,  if 
A  «  1. 

•  A  ^-operator  implementation  requires  a 
larger  dynamic  range  than  the  ^-operator 
implementation,  if  A  <<  1.  the  chance  of 
overfiow  increases. 

•  To  avoid  overfiow  problems,  the  ^-operator 
system  needs  to  be  implemented  with  a 
larger  wordlength. 


7 


Forced  Response  Case: 


System  description  for  the  ^-operator: 


^n+l 


f  (Sn  j  M.n) 


=  f{s.„,Un) 

^  •  •  • )  '^1?  •  *  •  )  '^k)  ) 


where  the  /^.’s  are  again  multivariate  polynomials  in 
up  to  M  +  variables. 


System  description  for  the  (^-operator: 


1  _  /(an)  -  Xn 

0[Xn\  —  ^ 

Xn+l  =  Xn  +  A^[X„] 


•  Using  a  similar  error  model  as  in  the 
zero-input  case,  the  computation  of  Xn+i  in 
the  g-operator  case  and  the  computation  of 
Sxn  in  the  6-operator  case  produce  bounds  of 
similair  magnitude. 

•  If  A  <<  1,  the  6-operator  system  again  has  an 
advantage  over  the  g-operator  system,  since 
the  errors  of  the  first  equation  are  much 
larger  than  the  ones  produced  in  the  update 
equation. 
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1.1.2.  The  Floating  Point  Case 
Q-Operator  model  —  ideal  case: 

x,(n  +  1)  =  E  •  •  ■  E  (1) 

n  *M 

^-operator  model  —  ideal  case: 

Sx,{n)  =  E  •  •  •  E  ^  (2a) 

II  IM  ^  ^ 

Xj{n  +  1)  =  Xj{n)  +  A6[xj{n)]  (2b) 


Model  for  floating  point  errors  due  to  multiplication 
and  addition: 


xQy  =  xy{l  +  e) 

x®y  =  a;(H- e)  +  2/(1  + €2) 

Consider  two  cases: 

(a)  1  with  =  0  for  1/  =  1,  •  •  • ,  M,  1/  ^  j 
and  ij  =  1. 

I^n,  ,*mI  <<  1  for  all  other  combinations  of  (ii,  •  •  • , 
x{n)e[-l,  +1]^ 

(b)  condition  (a)  is  not  satisfled. 


9 


Case  (a): 


6-operator  bounds  on  quantization  error  are  much 
smaller  than  ^-operator  bounds. 

Qualitative  explanation: 

For  case  (a),  all  partial  sums  and  products  in 

the  computation  of  A  •  6[xj{n)]  are  much 
smaller  than  Xj[n).  Therefore  the  errors  in 
the  computation  of  A6[xj(n)]  are  smaller 
compared  to  the  final  addition  error  in  (2b). 
Therefore  the  6-operator  model  implicitely 
performs  operand  sorting,  which  is  known  to 
reduce  quantization  errors  in  fioating  point 
arithmetic. 

Case  (b): 

6-operator  error  bounds  are  slightly  larger 
than  ^-operator  bounds. 


other  classes  of  nonlinear  systems  exist  which  also 
perform  better  using  a  ^-operator  formulation.  One 
such  class  is  the  weakly  nonlinear  functions  satisfying: 


=  Xj  €j{xi,’  '  '  Xm) 

with  \€j{xi,  -  • '  ,xm)\  «  \xj\ 
j  = 

(If  fj{xi,  •  •  • ,  xm)  is  of  polynomial  type,  the  system  has 
to  operate  on  a  hypercuboid  or  another  finite  subspace 
of  3^^  since  polynomials  cannot  be  weakly  nonlinear  in 
the  above  sense  for  all  Xie^.) 


Note'. 

If  equations  (1)  or  (2)  arise  from  quantizing  a  con¬ 
tinuous  time  system  with  a  very  short  sampling  time, 
then  the  condition 

\xj{n)\  »  |A^Xj(n)| 

can  be  satisfied  giving  the  <5-operator  formulation  an 
advantage  over  the  ^-operator. 


1.1.3.  A  Generalized  Delta- Operator  Model  for  Line£ir 
and  Nonlinezir  Systems 

Linear  Case: 

Assume  the  system  is  given  by: 

x{n  +  1)  =  Aqx{n)  +  Bqu{n) 

Consider  the  modified  A-operator  form: 

- x{n)  + — u{n) 

x{n  4- 1)  =  A^xin)  +  Bou{n)  4-  A6[x{n)] 

with  Aq  and  Bq  being  integer  matrices  closest  to  Aq 
and  Bq  respectively. 

Advantages 

•  The  dynamic  range  of  the  A^  and  B^ 
matrices  becomes  smaller  and  the  chance  of 
overfiow  is  reduced. 

•  The  delta  operator  realization  has  the  same 
improved  sensitivity  as  in  the  regular 
delta-operator  case. 

•  In  fioating  point  arithmetic,  the  condition 
Aq  I  is  not  necessary  for  improved  error 
behavior  of  the  delta-operator  system. 
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Nonlinear  Case: 


A  similar  argument  as  in  the  linear  case  can  be  made 
for  weakly  nonlinear  systems  of  the  form: 

x(n  +  1)  =  Aqx(n)  +  Bqu{n)  4-  €{x{n),u{n)) 

where 

II  £($(n),u(n))  ||«||  $(n)  || 

and  II  e(x(n),u(n))  ||<<||  w(n)  || 
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1.2.  Nonlinearities  of  Piecewise  Linear  Form 

1.2.1.  The  Fixed  Point  Case 

Although  a  piecewise  linear  continuous  scalar  func¬ 
tion  f:  can  be  represented  as 

f{x)  =  -  fjii\ai)  +  6, 

i 

a  computationally  more  efficient  realization  is: 

f{x)  =  CiX  +  di  for  Xi  <x  <  Xi  (1) 

Therefore,  the  resulting  system  Xn+i  =  /(^n)  can  be 
written  in  form  of  several  linear  state  space  equations 
with  a  driving  term,  and  the  driving  terms  being  known 
a  priori: 

6  —  operator: 

6[Xn]  =  AfXn  +  uf 

^n+1  —  —n  1  1,  ‘  5 

q  —  operator: 

^n+l  “  “h  2Ai  j  ^  1)  *  ‘  *  j  ^ 

Conclusion: 

•  For  single  precision  (quantization  after 
products)  the  absolute  error  bounds  for  the 
^-operator  realization  are  smaller  than  for 
the  ^-operator  realization. 

•  For  double  precision  (quantization  after 
summation)  the  absolute  error  bounds  for 
the  ^-operator  realization  are  approximately 
the  same  as  for  the  ^-operator. 
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1.2.2.  The  Floating  Point  Case 


Due  to  (1),  the  system  can  be  modeled  as  a  time- 
variant  linear  system  with  a  known,  piecewise  constant 
input.  Therefore  the  same  conclusions  apply  as  in  the 
linear  t.i.v.  case  with  regard  to  absolute  error  bounds: 

•  Generally,  absolute  error  bounds  of  the  6- 
and  g-operator  system  are  of  similar  size. 

•  If  the  resulting  A-matrices  of  the  piecewise 
linear  system  are  all  ‘close’  to  the  identity 
matrix  I,  then  the  5-operator  system  will 
perform  superior  to  the  g-operator.  (see 
comments  in  1. 1.2.).  This  requires  that  the 
driving  terms  are  also  small  relative  to  the 
states. 


1.3.  Sector  Bounded  Nonlinear  Functions 

1.3.1.  The  Fixed  Point  Case 
System  description: 


Xi{n  +  1)  =  +  •  •  •  +  im^m  (’^)] 

i  =  1,  •  •  • ,  m. 


Sector  conditions  on  J-[  ]: 


If  6ij(n)  is  the  error  affiliated  with  the  computation 
of  the  response  of  the  q  and  ^-operator  system 

can  be  absolutely  bounded  by  the  following  majorant 
system: 

q- operator: 

xf{n  +  1)  =  E  +  E  ej(n),  i  =  1,  •  •  •  ,m 

j=i  j=i 

where 


mfj  =  max{  \ki  j  Oi  j\^\kijaij\} 

4i{n)  =  hj{n)\ 
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6 -operator 


xt(n  +  1)  =  E  mfjxjin)  +  A  \eX{n)  +  E  ejln))  +  €+ (n), 
i=i  \  i=i  / 

2  =  1,  •  •  •  ,m 

where 

e;[p(n)  =  |eup(n)|,  eup{n)  :  error  occurring  in  update  equation 
6j(n)  =  |eA(n)|,  e^in)  :  error  due  to  division  by  A. 

Comparison: 

The  bound  for  the  ^-operator  implementation  is  lower 
if 


•  Since  the  bound  for  \efj{n)\  is  typically  much 
larger  than  for  |€j(n)|  or  |e+ (n)|,  it  is  obvious 
that  for  A  <<  1,  the  above  condition  is  always 
satisfied. 

•  A  similar  result  holds  if  the  nonlinearities  J- 
enter  the  system  in  a  different  form,  i.e.,  if 
they  have  arguments  which  consist  of  partial 
sums. 

•  A  simil8Lr  comparison  arises  for  other  fixed 
point  quantization  formats. 
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1.3.2.  The  Floating  Point  Case 

Generally,  the  ^-operator  implementation  is  not  su¬ 
perior  to  the  g-operator  implementation  if  one  com¬ 
pares  absolute  error  bounds.  However,  as  stated  be¬ 
fore  (1.1.2,  1.2.2),  if  the  condition 

\xi{n)\  »  |A^(xi(n))| 

holds  true  for  all  states  (i  =  1,  •  •  •  ,m),  then  the  ^-operator 
implementation  has  a  significantly  smaller  error  bound. 

A  class  of  systems  satisfying  the  above  condition  is 
given  by: 

Xiin  4"  l)  =  4"  *  *  ’  4" 

i  =  1,  •  •  •  ,m 

where 

^ij  ^  [— ij)  ^ij\  ^  j : 

hi  €  [1  -  eu,  1  +  €ii]  otherwise, 

\€ij\  «  1  for  i,j  = 

Again,  such  a  system  could  arise  from  a  continuous 
time  system  with  a  high  sampling  rate. 
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II.  Comparison  of  Implementations 


FXP-case 

FLP-case 

BFLP-case* 

general  system:  q- 
error  bounds 

^-operator  is  mostly 
superior 

5  and  g-operator  are 
comparable 

similar  to  FXP  case? 

g-error  bounds  for  a 
short  sampling  time 
in  the  discretization 
process 

(^-operator  is  mostly 
superior 

5  operator  is  superior 

similar  to  FXP  case? 

limit  cycles  (linear 
case  only) 

5-operator  produces 
incorrect  equilibria 

limit  cycles  in  under¬ 
flow  for  both  q  and  5- 
operator 

similar  to  FLP  case 

hardware  require¬ 

ments  for  small  A 

5-operator  requires 
longer  registers  than 
qr-operators 

independent  of  A 

overflow  effects 

5-operator  is 

more  likely  to  cause 
overflow 

in  both  operators 
unlikely 

similar  to  FLP  case 

general  sensitivity 

S  operator  superior 

5-operator 

better  than  or  equal 
to  ^-operator 

similar  to  FXP  case? 

sensitivity  for  a  short 
sampling  time  in  dis¬ 
cretization  process 

5-operator  superior 

5  operator  superior 

similar  to  FXP  case? 

*  has  not  been  analyzed  in  detail  yet,  expected  results. 
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SEMIANNUAL  PERFORMANCE  REPORT 
GRANT  NO’s:  N00014-94- 1-0387 


Summary  of  Phase  Pi  Results 

Phase  PI  consists  of  two  tasks: 

[Tl]  Task  Tl:  Analysis  and  design  of  finite  wordlength  implementations  of  linear,  time- 
invariant  ^-Systems. 

[T3]  Task  T3:  2-D  and  m-D  ^-system  models. 

The  major  part  of  task  Tl  was  carried  out  at  the  University  of  Notre  Dame  by  Dr. 
Peter  H.  Bauer  while  the  major  part  of  task  T3  was  carried  out  at  the  University  of 
Miami  by  Dr.  Kamal  Premaratne  under  grant  No.  N00014-94-1-0454.  The  project  being 
an  extensive  collaborative  effort,  the  two  Pi’s  have  been  in  constant  contact  during  this 
research  effort. 

The  following  is  a  summary  of  the  phase  PI  results. 

Task  Tl;  Analysis  and  Design  of  Finite  Wordlength  Implementations  of  Linear, 
Time-Invariant  ^-Systems 

The  conclusions  drawn  from  the  work  conducted  for  task  Tl  may  be  summarized  as  follows: 

1.  The  Fixed-Point  Arithmetic  Case:  When  limit  cycle  performance  is  crucial,  the  q- 
operator  implementation  is  preferrable.  The  ^-operator  implementation  is  superior 
with  regard  to  coefficient  sensitivity  issues. 

2.  The  Floating-Point  Arithmetic  Case:  Generally,  the  ^-operator  implementation  out¬ 
performs  its  ^-operator  counterpart.  In  particular,  in  high-order  and  high-speed  ap¬ 
plications,  the  ^-operator  implementation  is  the  best  choice. 

Prior  to  a  more  detailed  exposition,  first  we  provide  qualitative  justification  for  the 
above  conclusion.  The  state  equations  of  a  ^-operator  system  can  be  written  as: 


<5[x](n)  =  A5x(n)  -f  R«u(n); 

5[x](n)  =  x(n)  -t-  A  •  ^[x](n). 

where  x  and  u  are  the  state  and  input  vectors,  respectively.  Here,  A  denote  a  positive  real 
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constant  (typically,  the  sampling  time).  The  symbol  5[-]  denotes  the  ^-operator,  that  is, 

(T1.2) 

and  g[-]  denotes  the  usual  g-operator,  that  is, 

g[x](n)  =  x(n  +  1).  (T1.3) 

The  corresponding  formulation  of  (Tl.l)  in  terms  of  the  ^-operator  is 

g[x](n)  =  Aqx{n)  +  J5,u(n),  (T1.4) 

where 

Aq  =  I  +  A  •  As  As  =  and  Bq  =  A- Bs Bs  = (T1.5) 

Now,  given  x  and  u,  both  representations  compute  ^[x]  with  a  certain  accuracy. 
Consider  the  ^-operator  formulation  in  (Tl.l).  Here  we  encounter  two  errors: 

1.  The  first  is  due  to  the  computation  of  ^[x],  that  is,  the  first  equation  in  (Tl.l).  We 
will  refer  to  this  equation  as  the  intermediate  equation. 

2.  The  second  is  due  to  the  eventual  computation  of  ?[x],  that  is,  the  second  equation 
in  (Tl.l).  We  will  refer  to  this  equation  as  the  wpdate  equation. 

Let  us  assume  that  the  total  error  in  computing  ^[x]  is  mainly  due  to  the  intermediate 
equation  in  (Tl.l)  (rather  than  the  update  equation).  Then,  by  choosing  A  sufi&ciently 
small,  the  total  error  in  computing  ^[x]  will  be  approximately  the  error  created  by  the 
update  equation  which  is  small!.  In  this  case,  the  ^-operator  representation  has  better 
finite  wordlength  properties  than  its  g-operator  counterpart  in  (T1.4). 

If,  however,  the  errors  accumulated  in  the  intermediate  and  the  update  equations  in 
(Tl.l)  axe  comparable,  g[x]  computed  through  the  ^-operator  representation  will  show 
approximately  the  same  error  as  that  computed  through  its  g-operator  coimterpart  as¬ 
suming  A  is  sufficiently  small.  If  A  is  not  sufficiently  smaller  than  one,  the  ^-operator 
representation  will  actually  perform  worse  than  the  g-operator  representation! 

If  the  error  introduced  in  the  update  equation  is  larger  than  that  in  the  intermediate 
equation,  the  ^-operator  representation  would  consistently  perform  worse!!  In  reality,  this 
case  is  very  unlikely  to  occur. 
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Next,  a  more  detailed  exposition  follows. 

Tl.l  The  Fixed-Point  Arithmetic  Case 

We  now  discuss  some  of  the  results  regarding  the  fixed-point  (FXP)  case.  Here,  our  results 
in  fact  indicate  that,  in  case  limit  cycle  behavior  is  crucial,  the  5-operator  representation 
is  NOT  suitable  with  this  arithmetic  scheme  [1].  Such  a  case  may  occur  when  nonlinear 
systems  axe  implemented  through  FXP  5-operator  based  schemes. 

Zero-input  limit  cycles.  Independent  of  A,  zero-input  limit  cycles  cannot  be  avoided 
in  FXP  5-implementations.  This  is  easily  explained  as  follows:  If  A  is  chosen  very  small, 
the  contribution  from  the  intermediate  equation  being  small  (since  5[x]  is  being  multiphed 
by  A),  during  the  update  equation,  ^[x]  can  be  quantized  to  x  creating  a  DC  limit  cycle, 
that  is,  an  incorrect  equilibrium  point  different  from  zero  results.  We  emphasize  that,  most 
of  the  desirable  properties  of  5-operator  implementations  are  based  on  a  small  A.  We  may 
also  show  that,  if  A  is  chosen  larger  (this  case  is  of  course  somewhat  less  important),  DC 
Umit  cycles  will  still  exist.  Hence,  5-operator  representations  cannot  be  implemented  limit 
cycle  free  in  FXP  format!  This  fact  is  independent  of  the  particular  realization  of  the 
system. 

Deadband  size.  Since  5-systems  cannot  be  implemented  limit  cycle  free  in  FXP  format, 
it  is  of  interest  to  investigate  te  the  size  of  such  limit  cycles  since,  in  certain  situations, 
such  small  limit  cycle  amplitudes  can  be  tolerated.  It  can  be  shown  that,  the  magnitude  of 
A  determines  the  magnitude  of  the  limit  cycle.  The  smaller  the  A,  the  larger  will  be  the 
deadband  and  hence  the  limit  cycle  magnitude.  An  approximate  relationship  regarding 
this  is 

A  X  size  of  deadband  =1,  (T1.6) 

where  the  size  of  deadband  is  measured  in  multiples  of  the  quantization  step  size.  Here, 
the  deadband  corresponds  to  that  obtained  by  considering  the  quantization  of  A  •  5[x]. 
Therefore,  the  usual  choice  of  a  small  A  creates  a  larger  deadband! 

The  input  driven  case.  Although  the  input  driven  case  is  not  part  of  the  originally 
proposed  work,  some  interesting  results  have  been  obtained.  For  small  values  of  A,  there 
exists  a  bounded  input  signal  that  does  not  allow  control  of  the  state  trajectory.  In  other 
words,  given  sufficiently  small  A,  the  state  trajectory  may  not  be  influenced  by  such  an 
input  signal. 

The  influence  of  the  realization.  First,  it  was  necessary  to  develop  a  suitable  scheme 
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to  investigate  the  effect  of  realization  on  the  presence  or  absence  of  limit  cycles.  In  this  di¬ 
rection,  for  the  g-operator  case,  a  computer-based  exhaustive  search  algorithm  that  checks 
for  limit  cycles  (DC  and/or  oscillatory)  has  been  developed  [5]. 

As  discussed  before,  we  have  shown  that,  a  stable  linear  time-invariant  <5-system  cannot 
be  implemented  limit  cycle  free  in  FXP.  The  size  of  the  deadband  however  also  depends  on 
the  particular  realization,  that  is,  the  structure  of  As.  Given  a  system  transfer  function, 
there  are  forms  which  minimize  this  deadband  size  with  respect  to  some  appropriately 
chosen  measure.  For  example,  in  order  to  minimize  DC  limit  cycle  amplitude,  one  may 
choose  the  normal  form  (in  terms  of  A«)  as  a  suitable  candidate. 

The  influence  of  quantization  nonlinearity  and  its  deadzone.  Since  a  larger  deadzone 
implies  larger  DC  limit  cycle  amplitudes,  the  use  of  quantizers  with  reduced,  or  even 
zero,  deadzone  was  therefore  proposed.  In  investigating  first-order  systems,  by  reducing 
the  deadzone,  it  was  found  that,  existence  of  DC  limit  cycles  can  indeed  be  reduced. 
Unfortunately,  other  oscillatory  limit  cycles  will  be  created.  This  phenomenon  is  due  to 
the  increased  gain  exhibited  towards  small  input  signals  by  the  quantizer. 

Scaling.  As  discussed  above,  we  have  shown  that,  independent  of  either  the  form  of 
As  or  the  magnitude  of  A,  a  FXP  implemented  6-system  cannot  be  free  of  zero-input  limit 
cycles.  Hence,  scaling  cannot  be  offered  as  a  possible  solution. 

T1.2  The  Floating-Point  Arithmetic  Case 

The  floating-point  (FLP)  implementation  of  6-systems  is  currently  rmder  investigation. 
The  results  obtained  so  far  are  very  encouraging,  and  indicate  that,  quantization  errors 
due  to  FLP  arithmetic  have  a  much  smaller  effect  on  the  system  behavior  than  in  the  FXP 
case.  In  fact,  preliminary  results  show  that,  for  6-systems  of  order  three  and  higher,  errors 
in  computing  g[x]  can  be  made  significantly  smaller  than  for  the  corresponding  ^-systems. 
This  is  because,  for  a  FLP  implementation  of  such  a  system,  errors  created  through  the 
intermediate  equation  are  larger  than  those  created  through  the  update  equation.  As 
previously  mentioned,  in  this  situation,  6-systems  behave  better  than  their  5-operator 
counterparts! 

Limit  cycles.  In  FLP  arithmetic,  a  linearly  stable  time  invariant  system,  imder  zero- 
input  conditions,  may  exhibit  four  types  of  responses:  A  diverging  response,  an  oscillatory 
periodic  response  of  arbitrary  magnitude,  an  oscillatory  periodic  response  in  imderflow, 
or  an  asymptotically  stable  response.  Only  the  last  two  response  types  are  acceptable  in 
practice.  It  is  well  known  that,  the  last  response  type  is  in  fact  a  very  stringent  requirement 
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and  is  often  not  required  in  practice.  Results  so  far  obtained  show  that,  when  the  require¬ 
ments  for  a  response  in  underflow  are  compared,  the  ^-system  requires  less  wordlength 
than  its  5-system  counterpart!  This  advantage  in  fact  grows  with  the  order  of  the  system!! 

Once  the  system  reaches  underflow  conditions,  the  ^-system  again  exhibits  DC  limit 
cycles.  However,  if  the  exponent  register  is  chosen  suflBiciently  large,  the  amplitude  of  these 
oscillations  can  be  made  extremely  small  and  hence,  for  all  practical  purposes,  this  problem 
is  solved. 

Deadband  size.  If  the  condition  on  the  mantissa  length  that  guarantees  convergence 
into  underflow  is  satisfied,  then  the  deadband  size  will  be  very  small.  Hence,  it  can  be 
neglected  for  all  practical  purposes.  This  assumes  a  properly  chosen  exponent  register 
length  since  the  exponent  register  length  determines  the  dynamic  range  of  underflow. 

The  Influence  of  the  Nonlinearity.  Unlike  the  FXP  case,  the  characteristic  of  the 
nonlinearity  has  only  a  minor  effect  on  the  system  behavior,  significant  differences  being 
present  only  in  underflow  conditions 

The  Underflow  case.  In  underflow,  the  5-system  seems  to  behave  worse  than  its  5- 
operator  counterpart.  This  is  mainly  due  to  the  fact  that,  a  FLP  system  in  underflow 
essentially  performs  very  similar  to  a  FXP  system.  However,  as  mentioned  above,  if  the 
dynamic  range  of  underflow  is  chosen  properly,  the  system  behavior  in  underflow  is  of  little 
practical  interest. 

Block  Floating-Point  Arithmetic.  Even  for  the  5-operator  case,  results  regarding  block 
FLP  implementations  are  lacking.  Hence,  investigations  regarding  block  FLP  implemen¬ 
tation  of  5-systems  is  in  its  early  stages.  In  order  to  obtain  a  comparison  between  the  two 
types  of  implementations,  current  research  is  geared  towards  obtaining  results  applicable 
for  the  5-operator  case. 

T1.3  The  Multi- Dimensional  Case 

The  results  on  one-dimensional  (l-D)  5-operator  implementations  in  FXP  arithmetic  di¬ 
rectly  carry  over  to  the  multi- dimensional  (m-D)  case.  The  existence  of  non-converging 
responses  along  the  boundary  of  the  causality  region  can  easily  be  proven  using  the  same 
type  of  argument  used  in  the  1-D  case.  Consequently,  5-operator  based  implementations 
of  m-D  systems  cannot  be  implemented  limit  cycle  free  in  FXP. 

Task  T3;  2-D  and  m-D  5-system  models 
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Discrete-time  systems  implemented  using  the  ^-operator,  as  is  clear  from  the  discussion 
above,  exhibit  superior  finite  wordlength  properties  with  FLP  arithmetic.  In  the  case  of 
FXP  arithmetic,  they  still  provide  superior  coefficient  sensitivity.  The  development  of  2-D 
and  m-D  models  applicable  for  ^-operator  implementations  was  hence  motivated  with  the 
expectation  that  these  properties  would  still  hold  true. 

The  conclusions  drawn  firom  the  work  conducted  for  task  T3  may  be  siunmarized  as 
follows:  Similar  to  the  1-D  case,  imder  FLP  arithmetic,  the  ^-operator  implementation  of 
2-D  and  m-D  discrete-time  systems  provides  the  best  choice.  Again,  this  is  particularly 
true  in  high-order  and  high-speed  appUcations. 

State-space  models.  In  Roesser  local  s.s.  model  of  ^-operator  formulated  2-D  discrete¬ 
time  systems  takes  the  form 


X 

+ 

4(3)  4(4) 

_  J±q  J-Lq 

Lx''(i,i). 

+  [■S5]u(i,i); 


y(^i)= 


x'‘(i,i) 

x"(i,i) 


+  [Dq]n{i,j) 


x'‘(i,i) 

x"(i,i) 


+  [Dg]vi{i,j), 


(T3.1) 


where  is  of  size  Uh  x  rih,  is  of  size  n„  x  n„,  etc.  Also,  9fc[-]  and  5„[-]  denote  the 
horizontal  and  vertical  shift  operators,  that  is, 


?ft[x](i,i)  =  x(i -M,j)  and  9t;[x](i,i)  =  x(i,; -t- 1).  (T3.2) 


To  exploit  the  advantages  of  5-operator  implementations,  analogous  to  the  1-D  case, 
we  define  the  operators 


<5fc[x](bi) 

^v[x](i,;) 


x(i  +  l,i)  -x(i,j)  _  gft[x](i,i)  -x(i,j) 

Ah  Ah 

x{i,j  ^  9v[x](i,i)-x(z,j) 


(T3.3) 


where  Ah  and  A^  are  two  positive  real  constants.  The  corresponding  5-operator  s.s.  model 
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may  then  be  obtained  as 


h[^^](i,j) 

^(2)1 

’x'^(i,i)' 

1 

L^4x1(i,j)J 

_A(3) 

AW 

ylhj). 

“t" 

=  [A] 

y(i,i)  =  [C(i)  C<2)] 
=  [C] 


+  [-Blue*,;); 


(T3.4) 


x’’(i,i) 


[x^bi) 

+  [D]u{i,j) 


+  [■D]u(i,i) 


This  is  the  2-D  version  of  the  intermediate  equation  mentioned  earher.  In  addition,  as  for 
the  1-D  case,  we  have  the  following  update  equations: 

9/i[x^](bi)  =  x'*(?,i)  +  Aft  •  4[x*](i,i); 

9«[x”](i,  j)  =  j)  +  A„  •  ^„[x'’](i,i). 


(T3.5) 


Note  that. 


Ag  =  I  +  A  ■  As  As  =  A~^  •  (Aq  —  In)’, 
Bq  —  A  •  B  Bs  =  A~^  •  Bq] 

Cq  =  Cs  ■<==»  Cs  =  Cq’, 

Dq  =  Ds  Ds  =  Dq. 

Here,  A  =  [AftJn*  0  A„/„  J  is  of  size  (nft  +  n„)  x  (nft  +  n^). 


(T3.6) 


The  associated  system  theoretic  notions,  such  as,  transition  matrix,  transfer  function, 
characteristic  equation,  etc.,  have  also  been  introduced.  This  s.s.  model  is  the  basis  for 
designing  2-D  filters  with  superior  finite  wordlength  properties.  The  design  procedures 
developed  are  expected  to  be  extremely  useful  in  obtaining  high-Q  2-D  and  m-D  digital 
filters  that  are  suitable  for  high-speed  applications. 


Stability,  In  the  1-D  case,  it  has  been  shown  that,  direct  techniques  with  no  recourse 
to  transformations  (that  first  converts  a  given  ^-system  to  its  g-system  coimterpart)  can 
provide  numerically  more  reliable  stability  checking  algorithms.  With  this  in  mind,  for  the 
2-D  case,  a  direct  stability  checking  technique  appUcable  to  the  corresponding  ^-system 
transfer  function  has  been  introduced.  For  this  purpose,  a  recently  developed  tabular  form 
was  extended  to  the  complex  coefficient  case  and  the  notion  of  Schur-Cohn  minors  was 
introduced  to  the  5-operator  case. 

Gramians  and  balanced  realization.  The  notions  of  reachability  and  observability 
gram  1  an  s  and  balanced  realization  have  been  introduced  for  the  5-operator  case.  In  order 
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to  do  this,  first,  the  relationship  between  the  gramians  for  the  S-  and  ^-operator  cases,  as 
defined  in  the  literature,  was  established.  The  reachability  and  controllability  gramians, 
that  is,  P  and  Q,  respectively,  for  1-D  5-systems  were  found  to  satisfy 

^  -  ^>r'SsB;(c-i  -  a;)-' 

2>rj7T,  l  +  (X3.7) 

where  Ts  is  the  stability  boundary  applicable  for  5-systems,  that  is,  7#  =  {c  €  :  |c  -f- 

1/A|  =  1/A}.  An  extension  of  this  is  then  used  to  define  the  2-D  gramians  of  5-systems 
represented  in  the  Roesser  model  developed  above. 

For  the  important  class  of  separable  (that  is,  separable-in-denominator)  systems,  it 
is  shown  that  these  gramians  may  be  computed  through  the  solution  of  four  Lyapunov 
equations.  These  notions  and  results  are  useful  in  many  applications,  such  as,  in  extracting 
reduced  order  models  of  5-systems. 

Sensitivity.  Measures  that  indicate  coefficient  sensitivity  of  the  5-models  developed 
above  have  been  introduced.  Unlike  what  is  available  in  literature,  this  development  is 
applicable  to  the  MIMO  case  as  well.  With  these  sensitivity  measures  as  a  guide,  devel¬ 
opment  of  Tninimnm  sensitivity  structures  has  been  carried  out.  The  connection  with  the 
corresponding  balanced  realizations  has  been  pointed  out. 

Roundoff  noise.  With  the  use  of  a  noise  model  that  takes  into  account  the  roundoff 
error  propagation  in  the  s.s.  model  developed  above,  structures  that  minimize  roundoff 
noise  have  been  developed. 
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ABSTRACT 

This  paper  analyzes  the  problem  of  global  asymptotic 
stability  of  delta-operator  formulated  discrete-time  sys¬ 
tems  implemented  in  fixed-point  arithmetic.  It  is  shown 
that  the  free  response  of  such  a  system  tends  to  pro¬ 
duce  period  one  limit  cycles  if  conventional  quantization 
arithmetic  schemes  are  used.  Explicit  necessary  con¬ 
ditions  for  global  asymptotic  stability  are  derived,  and 
these  demonstrate  that,  in  almost  all  cases,  fixed-point 
arithmetic  does  not  allow  for  global  asymptotic  stability 
in  delta-operator  formulated  discrete- time  systems  that 
use  a  short  sampling  time. 


I.  INTRODUCTION 

Recently,  discrete-time  systems  formulated  with  the  in¬ 
cremental  difference  operator  (or,  (5-operator)  have  been 
receiving  considerable  attention  in  the  technical  litera¬ 
ture  [1-4].  Most  of  this  work  focus  on  its  superior  per¬ 
formance  under  finite  wordlength  conditions  when  com¬ 
pared  with  those  formulated  with  the  shift-operator  (or, 
(^-operator).  In  particular,  investigations  of  coefficient 
sensitivity  and  quantization  noise  properties  have  re¬ 
vealed  that  6-operator  formulations  usually  perform  sig¬ 
nificantly  better  than  their  ^-operator  counterparts  [1- 
4].  This  is  especially  true  for  high-speed  applications 
where  the  sampling  rate  is  much  larger  than  the  un¬ 
derlying  system  bandwidth.  Under  these  conditions,  q- 
operator  formulated  discrete-time  systems  tend  to  be¬ 
come  ill-conditioned  [1-2]. 

Although  a  large  amount  of  work  is  available  on  the 
effects  of  coefficientsensitivity  and  quantization  noise,  a 
deterministic  study  of  the  nonlinear  behavior  of  discrete¬ 
time  systems  formulated  with  the  6-operator  has  not 
been  undertaken.  In  the  case  of  floating-point  (FLP) 
arithmetic,  some  results  for  feedback  system  are  avail¬ 
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able  in  [2]. 

In  this  work,  we  focus  on  the  convergence  behavior  of  the 
unforced  system  response  and  global  asymptotic  stabil¬ 
ity  of  6-operator  formulated  discrete-time  systems  imple¬ 
mented  in  fixed-point  (FXP)  arithmetic.  In  particular, 
via  necessary  conditions  for  stability,  it  will  be  shown 
that  such  systems  tend  to  produce  DC  limit  cycles. 

The  structure  of  this  article  is  as  follows:  In  Section  II, 
we  introduce  notation  and  nomenclature.  The  model  for 
6-operator  formulated  discrete-time  systems,  with  and 
without  quantization  nonlinearities,  is  briefly  discussed. 
Section  III  addresses  the  problem  of  asymptotic  stability 
when  FXP  arithmetic  is  used  for  the  implementation. 
In  terms  of  ensuing  DC  limit  cycles,  necessary  condi¬ 
tions  for  global  asymptotic  stability  are  formulated.  It 
is  shown  that,  when  FXP  arithmetic  is  used,  stability 
of  the  linear  system  is  often  lost.  Section  IV  provides 
concluding  remarks. 

II.  NOTATION  AND  NOMENCLATURE 

Since  our  focus  is  on  investigation  of  stability  proper¬ 
ties  of  6-operator  formulated  discrete-time  systems  un¬ 
der  unforced  conditions,  the  state  equations  of  the  sys¬ 
tem  under  zero-input  will  be  considered. 

In  the  linear  case,  the  general  m-th  order  state-space 
representation  is  given  by 

(5[x](n)  =  A^x(n);  (1) 

x(n  +  1)  =  x(n)  +  A  ■  6[x](n),  (2) 

where  x(n)  =  [xi(n), . . .  ,  Xm{n)]'^  is  the  state  vector  at 
instant  n,  =  {a^^}  €  jg  system  matrix, 
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and  A  >  0  is  the  sampling  time.  Moreover,  6[  ]  repre¬ 
sents  the  6-operator,  that  is. 


6[xy](n)  = 


x‘^{n  +  1) 


-,  Vi/  = 


and  6[x](n)  =  [6[xi](n), . . .  ,6[xm](n)F.  The  actual  im¬ 
plementation  of  (1)  and  (2)  in  FXP  format  gives  rise  to 
nonlinear  quantization  operations  that  occur  at  various 
locations  depending  on  the  hard\vare  realization. 

Eqn.  (1)  can  be  implemented  either  by  using  single 
wordlength  accumulators  (creating  a  quantization  error 
after  each  multiplication)  or  by  using  double  wordlength 
accumulators  (creating  a  quantization  error  only  after 
summation).  We  will  only  consider  the  latter  option 
since  practically  all  modern  DSP  machines  implement 
this.  Eqn.  (1)  can  then  be  written  as 

5[x](n)  =  Q{A'^x(n)},  (4) 

where  Q  is  a  vector-valued  quantization  nonlinearity  of 
the  form 

Q{x}  = 

\  Q{Xm^ 

Here,  Q{xu}  denotes  magnitude  truncation,  two’s  com¬ 
plement  truncation,  or  rounding. 

Eqn.  (2)  can  be  implemented  in  two  different  ways: 


III.  NECESSARY  CONDITIONS 
FOR  STABILITY 

First,  we  will  consider  the  system  described  by  {(4),  (6)}. 
From  the  definition  for  global  asymptotic  stability  as 
stated  in  the  previous  section,  it  is  necessary  that 

•  6[x](n)}  0,  for  any  x(n)  0.  (8) 

This  is  just  one  of  a  finite  set  of  conditions  that  is  re¬ 
quired  to  ensure  global  asymptotic  stability  of  a  FXP 
implementation  of  a  linearly  stable  system  [5]. 

In  the  case  of  rounding,  condition  (8)  is  violated  if 

|A  •  (5[xt/](n)|  <  ^,  for  any  =  (9) 

The  sampling  time  A  in  a  6-operator  formulated  imple¬ 
mentation  is  typically  very  small.  With  A  —  I  t  and  (9), 
we  have 

|6[xv](n)|  <  ^,  for  any  =  (10) 

where  /  is  a  positive  integer. 

In  the  case  of  magnitude  truncation,  (10)  takes  the  form 
\S[xu]{n)\  <  j,  for  any  t/  —  l,...m.  (11) 


x(n  +  1)  =  x(n)  -f-  Q{A  •  6[x](n)},  (6)  Accordingly,  for  two’s  complement  truncation,  we  have 


or 

X  Q{x(n)  +  A  •  6[x](n)}.  (7) 

Eqn.  (6)  corresponds  to  quantization  after  multiplication 
while  (7)  corresponds  to  quantization  after  summation. 
In  contrast  to  (1),  for  (2),  it  is  not  clear  which  of  the 
two  quantization  schemes  in  (6)  and  (7)  is  preferable. 
We  will  therefore  consider  both  possibilities. 

Throughout  this  paper,  we  will  use  the  following  defini¬ 
tion  of  stability: 

Definition.  The  discrete-time  system  in  {(4),  (6)} 
or  {(4),  (7)}  is  globally  asymptotically  stable  if  and 
only  if,  for  any  initial  condition  x(0),  the  state  vec¬ 
tor  X  asymptotically  reaches  zero,  that  is,  x(n)  — ►  0 
for  n  — ^00. 

Comment.  Since  the  FXP  systems  considered  are  in  fact 
finite  state  machines,  the  condition  x(n)  — ►  0  for  n  — >  00 
may  be  restated  as  x(Y)  =  0  for  some  finite  N  [5]. 

Finally,  the  symbol  i  is  used  to  denote  the  quantization 
step. 


0  <  6[xi/](n)  <  j,  for  any  i/-l,...,m.  (12) 

Conditions  (10-12)  describe  the  deadband,  in  terms 
of  6[x],  for  which  a  DC  limit  cycle  occurs.  Such  a  limit 
cycle  can  be  avoided  if  (10-12)  are  satisfied  by  the  zero 
vector  only.  In  the  case  of  rounding,  we  therefore  require 


or,  equivalently, 

A>1,  (13) 

2 

which  is  impractical.  Similarly,  for  magnitude  and  two’s 
complement  truncation,  we  obtain 

£  >  j  A  >  1,  (14) 

which  again  is  equally  impractical. 

This  result  is  summarized  in  the  following  theorem. 
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In  the  case  of  the  remaining  two  quantization  schemes, 
the  inequalities  corresponding  to  (16)  are  given  as  fol¬ 
lows:  For  two’s  complement  truncation, 


Theorem  L  A  necessary  condition  for  stability  of  the 
(^-operator  formulated  discrete-time  system  in  {(4),  (6)} 
is  A  >  0.5  for  rounding  and  A  >  1  for  truncation. 


The  above  theorem  sfeows  that  high-speed  (5-operator 
formulated  implementations  that  possess  a  small  sam¬ 
pling  time  cannot  be  realized  limit  cycle  free  in  FXP 
format! 


0  <  •  x(n)  < 


/- 


x(n)7^0,  (17) 


A  second  necessary  condition  for  the  system  in  {(4),  (6)} 
can  be  obtained  by  noting  that 

6[x](n)  =  0  (15) 

can  occur  in  (4)  even  though  the  state  vector  x(n)  ^  0. 

Therefore,  for  rounding,  no  nonzero  state  vector  x(n) 
that  satisfies 


('] 

<  a' 

•  x(n)  <  + 

ViJ 

[u 

and,  for  magnitude  truncation, 

/'\ 

<  ■  x(n)  <  + 

vJ 


('\ 

vJ 


x(n)  7^  0.  (18) 


A  similar  analysis  can  be  conducted  for  the  system 
in  {(4),  (7)}.  Since  (4)  is  common  to  both  realizations, 
(16-18)  are  still  valid  and  provide  conditions  under  which 
the  finite  difference  is  quantized  to  zero  and  a  DC  limit 
cycle  is  produced.  We  will  now  briefly  discuss  neces¬ 
sary  conditions  for  global  asymptotic  stability  obtained 
from  (7). 


may  be  allowed  to  exist.  Here,  the  inequality  has  to 
hold  elementwise.  Taking  norms  on  both  sides  of  (16) 
one  gets  an  algebraic  condition  on  the  system  matrix 
that  always  support  DC  limit  cycles.  Eqn.  (16)  has  the 
following  interesting  interpretations: 

1.  Each  of  the  resulting  m  inequalities  can  be  geomet¬ 
rically  interpreted  as  the  intersection  of  two  half 
spaces  in  3^”^.  These  intersections  are  symmetric 
about  the  origin  and  have  parallel  boundaries.  The 
normal  vector  to  the  boundaries  is  given  by  the 
particular  row  vector  of  .  Only  if  the  intersec¬ 
tion  of  all  such  m  half  spaces  contains  a  nonzero 
point  in  and  if  it  belongs  to  the  quantization 
lattice,  will  there  exist  a  nonzero  state  vector  that 
is  an  equilibrium  point  of  the  system. 

2.  Eqn.  (16)  can  also  be  interpreted  from  an  eigen¬ 
value/eigenvector  viewpoint.  In  high-speed  digi¬ 
tal  filters  where  the  sampling  frequency  is  typically 
much  higher  than  the  bandwidth  of  the  processed 
signal,  a  ^-operator  implementation’s  eigenvalues 
cluster  around  the  point  z  =  1  [l].  The  correspond¬ 
ing  (5-operator  implementation  for  large  sampling 
times  has  eigenvalues  clustered  around  zero.  How¬ 
ever,  as  the  sampling  time  becomes  small,  these 
eigenvalues  move  towards  the  eigenvalues  of  the 
underlying  continuous-time  system  [l].  In  other 
words,  for  large  sampling  times,  the  system  matrix 
will  be  ill-conditioned,  that  is,  vectors  x(n)  ^  0 
exist  such  that  A^  •x(n)  is  close  to  the  zero  vector. 
According  to  (16),  this  is  likely  to  cause  a  DC  limit 
cycle.  For  small  sampling  times,  this  problem  may 
not  occur;  however,  in  this  case,  the  conditions  in 
Theorem  1  are  not  satisfied! 


For  rounding,  proceeding  as  in  (9),  we  have 
i 

|A  •  5[xv](n)|  <  -,  for  any  i/=:l,...,Tn, 
and  therefore 

|(5[ii/](n)|  <  for  any  u  =  (19) 


For  magnitude  truncation,  we  obtain 


0  <  6[a;i/](n)  <  y,  V(5[xv]  >  9, 

(20) 

and 

-I 

—  y  <  6[a.v](n)  <  0,  V6[ari/]  <  0. 

(21) 

In  the  case  of  two’s  complement  truncation 
tion  for  a  DC  limit  cycle  is  given  by 

,  the  condi- 

0  <  6[a:i/](n)  <  y,  Vi/  =  l,...,m. 

(22) 

With  A  =  /  •  £,  /  being  a  ‘small’  integer,  we  come  to  the 
same  conclusion  as  for  the  previously  considered  system: 

A  >  -  for  rounding; 

A  >  1  for  truncation. 

Therefore,  Theorem  1  also  holds  for  the  system  repre¬ 
sentation  in  {(4), (7)}. 
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IV.  CONCLUSION 

Via  a  set  of  necessary  conditions  for  global  asymptotic 
stability,  it  has  been  shown  that  high-speed,  limit  cycle 
free  (^-operator  Jsmplementations  of  linear  discrete- time 
systems  cannot  be  realized.  This  is  due  to  the  tendency 
of  such  a  realization  to  produce  period  one  limit  cycles. 
This  situation  arises  from  small  values  in  the  finite  dif¬ 
ference  being  quantized  to  zero.  Hence,  convergence  to 
the  ‘wrong’  equilibrium  point  is  very  likely.  Conditions 
on  the  system  matrix  and  the  sampling  time  if  such  limit 
cycle  behavior  is  to  be  avoided  have  been  provided.  The 
results  indicate  that,  in  high-speed  applications,  these 
conditions  cannot  be  satisfied  with  conventional  quanti¬ 
zation  schemes. 
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Abstract —  In  this  paper,  the  convergence 
properties  of  linearly  stable  multi- dimensional 
systems  are  investigated  for  the  case  of  delta- 
operator  implementations  in  fixed-point  format. 
It  is  shown  that  zero-convergence  is  almost  never 
achieved,  if  the  sampling  time  is  small.  Using  a 
one-dimensional  analysis,  it  is  demonstrated  that 
zero-convergence  cannot  be  guaranteed  along  the 
axis  of  the  first  hyper-quadrant  for  a  first  hyper¬ 
quadrant  causal  system.  This  limits  the  use 
of  delta-operators  for  solving  partial  differential 
equations  in  discrete  time  with  fixed-point  arith¬ 
metic. 

I.  INTRODUCTION 

Delta-operator  (or,  6-operator)  implementations  of 
discrete-time  systems  have  been  the  topic  of  a  number 
of  research  papers  within  the  last  decade.  A  compre¬ 
hensive  treatment  of  the  properties  of  6-operator  imple¬ 
mentations  can  be  found  in  [l].  It  is  well  known  that 
6-operators  outperform  shift-operators  (or,  ^-operators) 
in  terms  of  their  finite  wordlength  properties  [2].  In  par¬ 
ticular,  its  quantization  noise  and  sensitivity  properties 
make  the  6-operator  an  interesting  alternative  to  the 
operator  in  areas  such  as  digital  control,  digital  signal 
processing,  and  generally  discrete-time  simulation  of  dy¬ 
namical  systems  described  by  differential  equations  [l], 

[3]-  .  .  . 

In  this  paper,  we  will  perform  a  deterministic 
analysis  of  the  finite  wordlength  properties  of  multi¬ 
dimensional  (m-D)  6-operator  implemented  discrete¬ 
time  systems.  In  particular,  we  will  investigate  the  zero- 
convergence  of  6-operator  fixed-point  implementations  of 
one-dimensional  (1-D)  and  m-D  systems.  Although  it  is 
of  vital  importance,  this  problem  has  not  been  investi¬ 
gated  thus  far  in  the  literature.  After  all,  asymptotic 
stability  and  convergence  to  the  true  equilibrium  points 
are  some  of  the  most  fundamental  requirements  for  any 
discrete- time  system  realization. 

This  article  is  organized  in  the  following  way:  Sec¬ 
tion  II  introduces  the  notation.  The  m-D  6-operator 
model  will  be  introduced  and  briefly  discussed.  This 
section  will  also  provide  the  problem  formulation.  Sec¬ 
tion  III  provides  necessary  1-D  stability  conditions  for 
m-D  first  hyper-quadrant  causal  systems  with  nonlin- 


0-7803-1797-1/94/S3.00  ©  1994  IEEE 


Kamal  Premaratne,  PhD 

Department  of  Electrical  and 
Computer  Engineering 
University  of  Miami 
Coral  Gables,  FL  33124 


earities.  Using  these  necessary  conditions,  section  IV 
provides  a  stability  and  convergence  analysis  for  m-D 
systems.  It  will  be  shown  that  the  resulting  1-D  systems 
cannot  ensure  zero-convergence.  Section  V  contains  con¬ 
cluding  remarks. 

II.  NOTATION  AND  PROBLEM  FORMULATION 

The  m-D  Roesser  model  has  the  following  6- 
operator  formulation  [4]: 


6(0  )](n) 


_6(^)[x(^^](n) . 


4^  ...  4^ 


+  u(n); 


ic(0(n) 


_x(”^)(n) . 


g(0[x(0](n) 


c(0(n) 


J  Lx(^)(n). 


6(^)[x(^^](n) 


L6(^)[x(^)](n)  J 

The  input-state  equations  in  (1)  and  (2)  describe  a  first 
hyper-quadrant  causal  m-D  system  with  a  uniform  sani- 
pling  period  of  A  in  all  directions.  The  operators  g(*^ 
and  6^*^  represent  the  shift-  and  delta-operator  in  the 
direction  specified  by  the  axis  n,.  In  particular 

=  ,  ■  ■ . ,  «i-i ,  rii  +  1,  ni+i , . . . ,  rim)  (3a) 

6(‘)[x(‘>](n) 


26 


-x(*)(n)). 


(3b) 


Here,  (n)  =  (ni , . ... ,  ^TTi )  clGnot6s  point  in  the  first 
hyper-quandrant,  x^)(n)  is  the  portion  of  the  state  vec¬ 
tor  propagating  in  the  direction  specified  by  the  axis  n,- , 
u(n)  is  the  m-D  input  vector,  and  and  Bf ,  fori  = 
1, .  •  • ,  i  =  1, .  .  . ,  m,  are  the  submatrices  of  the  sys¬ 
tem  and  input  matrices,  respectively. 

If  (1)  is  realized  in  fixed-point  arithmetic,  it  takes 
the  following  form  under  zero-input  conditions: 

r  6n){x(i)](n)] 


6(^)[x(i)](n). 

r 


=  Q 


Mm  1 


c(i)(n) 


Lx("‘)(n)J 


/  XI 

where  Q{x}  =  |  |  with  ^  =  | 


(4) 


Equation  (4)  assumes  quantization  after  summa¬ 
tion;  since  practically  all  modern  DSP  machines  imple¬ 
ment  this  quantization  scheme,  we  utilize  this.  The 
vector-valued  quantization  nonlinearity  Q{  }  may  rep¬ 
resent  any  one  of  the  conventional  schemes,  viz.,  magni¬ 
tude  truncation,  magnitude  rounding,  two’s  complement 
truncation,  and  two’s  complement  rounding. 

Equation  (2)  can  be  implemented  in  two  different 
forms: 


r  (7(i)[xt')](n)  1 


L^(m)[x(m)](n)J 


-  x(‘)(n)  - 

6^^  ^[x(^)](n) 

1 

+  Q  < 

A  . 

1 

( 

.x(’")(n). 

r 

? 

? 

1 _ 

J 

r  -I 


Lg(m)Jx(m)](n) 


f 

"  x^^)(n)  " 

(5(i)[x(C](n) 

+  A  • 

^  .(6) 

1 

? 

? 

1 _ 

> 

Equation  (5)  corresponds  to  quantization  after  multi¬ 
plication,  whereas  (6)  corresponds  to  quantization  after 
addition.  In  contrast  to  (1),  for  (2),  it  is  not  obvious 
which  of  the  two  forms  stated  above  is  preferable. 

The  following  definition  for  asymptotic  stability  [5] 
will  be  used  throughout  this  paper. 

Definition.  An  m-D  first  hyper-quadrant  causal  discrete¬ 
time  system  is  asymptotically  stable  under  all  finitely 
extended  bounded  input  signals  u(n)  where 

|u(n)|  <  S,  for  ni  -I - rim  <  D;  (7) 

u(n)  =  0,  for  m  -i - hnm>D,  (8) 

if  all  the  states  of  the  m-D  discrete-time  system  asymp¬ 
totically  reach  zero  for  ui  -}-•••  -f  rzm  oo.  Here, 
n,y  >  0,  1/  =  1, .  .  .  ,m,  S  is  a  nonnegative  real  number, 
and  D  is  a  positive  integer. 

Since  the  fixed-point  systems  considered  are  in  fact 
finite  state  machines,  the  condition 

/x(i)(n)\ 


\x(^)(n)  / 

for  ni  -h  •  •  -h  rim  — ►  oo,  nj/  >  0,  =  1, , . . ,  m,  can  be 

strengthened  to 

/x(i)(n)  \ 

:  =0, 

Vx(”‘)(n)  / 

for  all  points  ni  H - h  rim  >  c,  >0,  i/  =  1, . . . ,  m, 

where  c  is  some  finite  integer. 

Problem  Formulation.  Analyze  the  asymptotic  zero- 
convergence  of  the  state  response  of  systems  in  (4,5) 
and  (4,6)  under  the  assumption  that  the  underlying  lin¬ 
ear  system  is  asymptotically  stable. 

III.  NECESSARY  CONDITIONS  FOR 
GLOBAL  ASYMPTOTIC  STABILITY 
OF  m-D  SYSTEMS 

In  this  section,  we  present  some  necessary  condi¬ 
tions  for  stability  of  a  first  hyper-quadrant  causal  m- 
D  discrete-time  system  represented  in  its  Roesser  local 
state-space  model  in  (1,2).  These  necessary  conditions 
are  formulated  in  terms  of  1-D  conditions.  This  theorem 
follows  directly  from  a  result  in  [6]  which  was  formulated 
for  ^-operator  implemented  discrete-time  systems.  The 
proof  of  the  theorem  rests  on  the  fact  that  a  first  hyper¬ 
quadrant  m-D  system  can  be  described  by  a  1-D  system 
for  those  locations  that  are  along  the  m  coordinate  axes 
of  the  boundary  of  the  hyper-quadrant.  Reformulating 
the  result  in  [6]  for  6-operator  systems  produces  the  fol¬ 
lowing  theorem: 
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Theorem  1. 

(a)  A  necessary  condition  for  global  asymptotic  sta- 
bility  of  the  system  in  (4,5)  is  that  each  of  the  following 
1-D  systems  in  (9,10)  is  globally  asymptotically  stable: 

6W[x(0](„,)  =  Q{[^f.]x(*^(«0};  (9) 

9(‘>[x(*)](n.)  =  x(‘)(ni)  +  Q  {a  •  6(‘')[x(‘)](ni)}  (10) 
where  i  =  1, . .  .  ,  m. 

(b)  A  necessary  condition  for  global  asymptotic  sta- 
bility  of  the  system  in  (4,6)  is  that  each  of  the  following 
in  1-D  systems  in  (11,12)  is  globally  asymptotically  sta¬ 
ble: 

6(‘>[x<‘)](n.)  =  Q  {[Af.]x(‘Hn.)}  ;  (11) 

9(0[x(*)](ni)  =  Q  {x(‘)(n.)  +  A  •  6(*)[x(')](n. ) }  (12) 
where  i  =  1, . . . ,  m. 

Proof.  For  a  detailed  proof,  and  generalizations  to  higher 
sub-dimensional  systems,  the  reader  is  referred  to  [6].  ■ 

Theorem  1  can  be  viewed  as  an  extension  of  the 
concept  of  practical  BIBO  stability  to  asymptotic  sta¬ 
bility  of  nonlinear  systems.  It  is  particularly  useful  in 
proving  instability  in  m-D  nonlinear  systems. 

IV.  NECESSARY  CONDITIONS  FOR 
GLOBAL  ASYMPTOTIC  STABILITY 
OF  1-D  SYSTEMS 

Let  us  rewrite  (9),  (10),  and  (12)  as  TD  matrix 
equations  of  order  K.  In  this  case,  (9),  (10),  and  (12) 
yield  (13),  (14),  and  (15),  respectively: 

r  <5[xi](«)  1 


(5[iK](f*) 


Now,  we  are  in  a  position  to  formulate  the  second  theo¬ 
rem  which  presents  a  necessary  condition  for  stability  of 
1-D  systems. 

Theorem  2.  A  necessary  condition  for  global  asymptotic 
stability  of  the  system  in  (13,14)  or  (13,15)  is  given  by 

A  >  0.5,  for  magnitude  rounding; 

A  >  1,  for  truncating. 

Proof.  For  global  asymptotic  stability  of  (13,14),  it  is 
necessary  that 


xi{n+  1) 


+  1)  J 

■  xi(n)  1  (  '  <5[xi](n)  ‘ 

=  +  Q  <  A  •  >  ;  (14) 

V.  j 

zi(n  +1)1 


Xfcin  +  1) 


a:i(n) 


^Kin) 


6[a:i](r 


<5[x/<-](n) 


Q  <  A 


.  (15) 


6[xi](n) 


(5[x/<](n) 


/xi(n)\ 

for  any  j  1  0- 

First,  we  will  address  the  case  of  magnitude  round¬ 
ing.  Obviously,  condition  (16)  is  violated  if,  for  Xi,  ^  0, 


|A  •  <5[x,/](n)|  <  -,  for  i/  =  l,...,A',  (17) 

where  i  is  the  quantization  step.  Expressing  the  sam¬ 
pling  time  A  as  an  integer  multiple  of  I,  we  have 

(18) 

where  I  is  some  (typically  small)  positive  integer. 
With  (17)  and  (18),  we  obtain  the  following  condition 
for  instability: 


for  Xt,  91^  0,  1/  =:  1, . , .  ,  m. 

Condition  (19)  is  not  satisfied  for  any  nonzero  value 
of  Xi/  (that  is,  the  condition  for  instability  is  not  satisfied) 
if  £  >  1/2/,  or  equivalently, 


A  > 

“  2 


This  proves  the  theorem  for  magnitude  rounding. 

For  the  case  of  magnitude  truncating,  (17)  takes 
the  form 

[A  ■  6[xv](n)|  <  f,  for  (21) 

Therefore,  (19)  becomes 


|6[x,;](n)l  <  J. 


This  finally  yields 

A  >  1.  (23) 

For  two’s  complement,  (17)  takes  the  form 
0  <  A  •  <5[x»x](n)  <  ^,  for  u  —  .  ,K.  (24) 

n; 

This  results  in 

0<6[x,]{n)<  i  (25) 

and  consequently,  A  >  1.  This  proves  the  theorem  for 
the  system  in  (13,14).  A  similar  argument  can  be  used 
for  the  system  in  (13,15)  by  considering  the  cases  for 
which 

{"  *i(«)  1  r  '5[a: 

:  +A- 

i/cCn)]  [6[xi 

XI  (n) 

for  nonzero  state  vectors. 

We  can  now  combine  Theorems  I  and  2  to  formu¬ 
late  a  necessary  condition  for  stability  of  m-D  first  hyper- 
quadrant  causal  ^-operator  formulations  of  the  general¬ 
ized  Roesser  model. 

Corollary  3,  A  necessary  condition  for  global  asymptotic 
stability  of  the  m-D  systems  in  (4,5)  or  (4,6)  is 

A  >  0.5,  for  magnitude  rounding; 

A  >  1,  for  truncatiing. 

Proof.  The  proof  follows  from  Theorems  1  and  2.  ■ 


Comments. 

1.  Theorem  2  and  Corollary  3  are  also  essentially  ap¬ 
plicable  to  the  case  where  the  sampling  time  varies 
with  the  direction  of  propagation.  In  this  case,  the 
inequalities  in  Theorem  2  and  Corollary  3  would 
have  to  be  replaced  by 

A,*  >  0.5,  for  magnitude  rounding; 

A,-  >  1,  for  truncating, 
for  t  =  1, . . . ,  m. 

2.  Most  of  the  previous  results  on  the  superior  fi¬ 
nite  wordlength  properties  of  6-operators  depend 
on  choosing  a  very  small  sampling  time  A.  In  such 
a  case.  Theorem  2  and  Corollary  3  show  that  the 
system  response  will  not  converge  to  zero  for  the 
unforced  case. 

3.  Our  analysis  is  limited  to  the  zero-input  case  for 
which  DC  limit  cycles  were  used  to  derive  condi¬ 
tions  for  non-convergence.  If  one  includes  other 
types  of  limit  cycles  in  the  analysis,  the  require¬ 
ments  for  A  may  become  even  more  severe. 

4.  Theorem  2  and  Corollary  3  show  that  fixed-point 
implementations  of  1-D  and  m-D  6-operator  sys¬ 
tems  cannot  be  realized  limit  cycle  free,  if  good  coef¬ 
ficient  sensitivity  and  quantization  noise  measures 
have  to  be  achieved.  See  also  [7]. 


V.  CONCLUSION 

In  this  paper,  it  was  shown  that  fixed-point  imple¬ 
mentations  of  1-D  and  m-D  6-operator  systems  are  not 
limit  cycle  free  even  if  the  underlying  linear  system  is 
stable  and  the  sampling  time  is  chosen  small.  This  non- 
convergent  behavior  can  be  explained  by  the  quantiza¬ 
tion  of  the  6-term  to  zero  which  leaves  the  state  vector 
unchanged.  The  smaller  the  sampling  time,  the  more 
severe  this  effect  is.  Therefore,  the  practical  value  of 
6-operators  for  fixed-point  implementations  of  1-D  and 
m-D  systems  is  questionable.  There  are  however  indica¬ 
tions  that  this  effect  is  much  less  severe  in  floating-point 
implementations. 

6-operator  implemented  discrete-time  systems  rep¬ 
resent  a  class  of  systems  where  the  quantization  noise 
at  the  output  can  be  small  compared  to  other  realiza¬ 
tions.  However,  as  was  shown  above,  such  realizations 
will  invariably  exhibit  limit  cycle,  that  is,  highly  cor¬ 
related  quantization  noise,  behavior.  Therefore,  in  this 
case,  typical  measures  for  quantization  noise  are  of  very 
limited  use  for  obtaining  any  insight  into  the  likelihood 
of  limit  cycles  and  vice  versa. 
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Abstract.  The  recent  interest  in  delta-operator  (or,  (5-operator)  formulated  discrete-time  systems  (or, 
(5-systems)  is  due  mainly  to  (a)  their  superior  finite  wordlength  characteristics  as  compared  to  their  more 
conventional  shift-operator  (or,  g-operator)  counterparts  (or,  ^-systems),  and  (b)  the  possibility  of  a  more 
unified  treatment  of  both  continuous-  and  discrete-time  systems.  With  such  advantages,  design,  analysis, 
and  implementation  of  twodimensional  (2-D)  discrete-time  systems  using  the  (5-operator  is  indeed  war¬ 
ranted.  Towards  this  end,  the  work  in  this  paper  addresses  the  development  of  an  easily  implement  able 
direct  algorithm  for  stability  checking  of  2-D  6-system  transfer  function  models.  Indirect  methods  that 
utilize  transformation  techniques  are  not  pursued  since  they  can  be  numerically  unreliable.  In  develop¬ 
ing  such  an  algorithm,  a  tabular  form  for  stability  checking  of  6-system  characteristic  polynomials  with 
complex- valued  coefficients  and  certain  quantities  that  may  be  regarded  as  their  corresponding  Schur-Cohn 
minors  are  also  proposed. 

Keywords.  Two-dimensional  discrete-time  systems,  two-dimensional  digital  filters,  6-operator  formulated 
discrete-time  systems,  bivariate  polynomials,  Schur-Cohn  minors,  stability. 
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1.  Introduction 


The  increased  interest  in  <5-systems  during  the  recent  years  (see  [1-6],  and  references 
therein)  is  due  mainly  to  two  reasons:  (a)  ^-systems  provide  superior  finite  wordlength 
properties  with  respect  to  roundoff  noise  propagation  [5]  and  coefficient  sensitivity  [1],  [5], 
[7],  as  compared  to  their  ^-system  counterparts,  and  (b)  the  ^-operator  yields  the  differ¬ 
ential  operator  as  a  limiting  case  when  sampling  time  approaches  zero  enabling  a  unified 
treatment  of  both  continuous-  and  discrete-time  systems  [1]. 

With  such  advantages  in  mind,  development  of  2-D  and  multi-dimensional  (m-D)  6- 
system  models  must  clearly  be  undertaken.  Such  research  can,  for  example,  provide  m-D 
digital  filters  with  superior  roundoff  error  and  coefficient  sensitivity  performance  allowing 
their  implementation  to  be  carried  out  in  a  shorter  wordlength  environment.  This  is 
especially  crucial  in  real-time  applications,  such  as,  in  implementing  narrow  bandwidth 
filters  under  high  sampling  rates  (for  example,  in  current  wide  bandwidth  communication 
system  applications)  where  traditional  ^-operator  implementations  perform  poorly  [8]. 

In  applications  mentioned  above,  and  those  dealing  with  high-speed  processing  of  2-D 
and  m-D  data  (for  instance,  in  weather,  seismic,  gravitational  photographs,  video  images, 
systems  with  routliple  sampling  rates,  etc.),  ensuring  stability  is  an  important  consideration 
(see  [9],  and  references  therein).  Given  the  characteristic  polynomial  of  a  ^-system,  to 
determine  stability,  one  may  first  use  a  variable  transformation  that  yields  a  more  familiar 
stability  region,  for  instance,  the  unit  bi-circle.  Then,  an  existing  technique  (see  [9-10], 
and  references  therein)  may  be  applied.  However,  such  techniques  are  known  to  be  prone 
to  numerically  ill-conditioning  [1],  [6].  In  the  1-D  case,  direct  stability  checking  methods 
for  ^-system  polynomials  are  in  [6]  (where  a  tabulai'  method  based  on  the  work  in  [11] 
is  given)  and  [12]  (where  a  Hermite-Bieler-like  Theorem  is  utilized).  Hence,  our  purpo.se 
here  is  to  develop  a  direct  easily  implementable  stability  checking  technique  applicable 
to  m-D  (5-systems.  As  usual,  for  notational  simplicity,  we  concentrate  on  the  2-D  case,  the 
extension  to  the  m-D  case  being  quite  straight-forward. 

In  checking  stability  of  bivariate  characteristic  polynomials,  two  conditions  must  be 
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satisfied. 

(a)  Condition  I  involves  a  1-D  stability  check  of  a  polynomial  with  real- valued  coefficients. 
One  may  use  the  table  form  in  [6].  Alternately,  one  may  utilize  an  explicit  root  location 
scheme. 

(b)  Condition  II  involves  a  stability  check  of  a  polynomial  with  complex- valued  coefficients 
where  the  latter  are  dependent  on  a  parameter  taking  values  on  a  certain  circle  in  the 
complex  plane.  Explicit  root  location  schemes  are  now  ineffective,  and  the  value  of  tabular 
methods  becomes  apparent.  Note  that,  in  such  a  situation,  compared  to  Nyquist-like 
techniques  [13],  tabular  methods  are  known  to  provide  certain  numerical  advantages  as 
well  [14]. 

In  checking  condition  II  for  2-D  ^-systems,  an  effective  technique  involves  checking 
positive  definiteness  of  the  Hermitian  Schur-Cohn  matrix  [15].  This  lets  one  use  an  impor¬ 
tant  simplification  due  to  Siljak  [16].  The  tabular  form  in  [15]  takes  full  use  of  this  since  it 
provides  the  Schur-Cohn  minors  (that  is,  the  principal  minors  of  the  Hermitian  Schur-Cohn 
matrix)  directly  from  its  entries  [15],  [17].  A  similar  simplification  applicable  to  ^-systems 
is  clearly  possible  if  condition  II  may  be  reduced  to  checking  positive  definiteness  of  a 
Hermitian  matrix. 

With  the  above  in  mind,  we  develop  the  following  in  this  paper:  (a)  Tabular  form 
for  stability  checking  of  5-system  characteristic  polynomials  possessing  complex-valued 
coefficients,  (b)  Analogs  of  Schur-Cohn  minors  and  a  corresponding  Hermitian  matrix 
applicable  for  such  systems,  and  (c)  a  direct  stability  checking  algorithm  for  2-D  5-system 
transfer  function  models. 

The  paper  is  organized  as  follows.  Section  2  introduces  the  notation  used  throughout 
and  a  brief  review  of  previous  results.  Section  3  develops  a  tabular  form  for  stability 
checking  of  5-systems  with  complex- valued  coefficients  and  some  important  relevant  results. 
Section  4  presents  quantities  that  may  be  regarded  as  the  analogs  of  Schur-Cohn  minors 
for  5-systems.  The  2-D  stability  checking  algorithm  in  Section  5  is  based  on  the  tabular 
form  for  real- valued  coefficients  [6].  Since  only  little  extra  work  is  needed,  results  in  both 
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Sections  3  and  4  however  are  developed  for  the  more  general  complex-coefficient  case. 
Section  6  presents  an  example  to  validate  the  results.  Section  7  contains  the  conclusion 
and  some  final  remarks. 
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2.  Preliminaries 


2.1.  Notation 


O'  Real  and  complex  number  fields. 


var{-} 
Re[-],  Im[-] 

N 

A,  A* 

3?(w) 

3J[u>l]„j  [tC2]„2 


Set  of  matrices  of  size  pxg  over  and  S,  respectively. 

Number  of  sign  changes  in  the  sequence  {•}  of  real 
numbers. 

Real  part  and  imaginary  part  of  [•]  E  Q. 

Complex  conjugate  of  [•]  G  Sj. 

Transpose,  complex  conjugate,  and  complex  conjugate 
transpose  of  A  G  respectively. 

Set  of  univariate  polynomials  of  degree  n  (with  re¬ 
spect  to  the  indeterminate  w  E  Q)  over  3f?  and  O', 
respectively. 

Set  of  rational  univariate  polynomials  (that  is,  quo¬ 
tient  of  univariate  polynomials)  over 
Set  of  bivariate  polynomials  of  relative  degrees  7ii 
and  712  (with  respect  to  the  indeterminates  Wi  E 
and  W2  E  Q,  respectively)  over 
Set  of  rational  bivariate  polynomials  over  3?. 


2:,  c  Indeterminates  of  q-  and  ^-systems,  respectively. 


r  Real  positive  number,  usually  the  sampling  time. 


The  transformation  relationship  between  corresponding  ^-and  ^-systems  is 


6  = 


z  -  1 
c  = - 


[•]  ^-system  quantity  analogous  to  its  corresponding  6- 
system  quantity  [•];  for  example,  transfer  function 
of  a  given  discrete-time  system  is  either  H[c)  if  im¬ 
plemented  based  on  the  (5-operator  or  H{z)  if  imple¬ 
mented  based  on  the  ^-operator. 

G(z)\z—.c  G'(2)|z  =  i  +  rc 


C2)  |c— >2  •^(*'1 5  ^2  )|c,  =(zi  —  l)/r,  i=l  ,2 

G(zi,Z2)\  z— G(zi  ,  Z2)\zi  =  l  +  TCi,i-l,2 


(2.1) 
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Stability  studies  of  1-D  and  2-D  q-  and  ^-systems  involve  the  following  regions: 


{ze 

: 

H<i}, 

{(^1,2^2) 

eSr^ 

♦  \^i\ 

<  1, 

z  =  l,2}. 

{ze 

: 

kl<i}, 

{(^1,^2) 

e  Sr^ 

■ 

<  1, 

^  =  l,2}. 

{ze 

Sr  : 

{(21)^2) 

G  Sr2 

=  1, 

^  =  l,2}. 

{ce 

Sr  : 

|c  +  l/r| 

<  lA}, 

{(ci, 

C2)  € 

S>2  : 

V 

+ 

I/t, 

i  = 

1,2). 

{ce 

Sr: 

|c  +  l/r| 

<  1/r}, 

{(01, 

C2)  € 

Sr2  : 

:  \ci  +  l/r|  < 

1/'^. 

i  = 

1,2}. 

T} 

{ce 

Sr  : 

|c  +  l/r| 

=  IM, 

{(ci, 

C2)  e 

S>2  : 

:  \ci  +  l/r|  = 

I/t, 

i  = 

1,2}. 

To  avoid  unnecessary  notational  complications,  the  sampling  time  in  both  horizontal  and 
vertical  directions  is  taken  to  be  equal  to  r  >  0. 

To  emphasize  the  degree  of  F{w)  =  ^  we  sometimes  denote  it 

as  F{w)n  as  well. 

F(w)  Conjugate  polynomial  of  F(w),  that  is, 

F'^(z)  Reciprocal  polynomial  of  F(z),  that  is,  z’^F(l/z) 

F^(c)  Reciprocal  polynomial  of  F(c),  that  is,  (1  -f  rc)” 

A  ^-system  polynomial  is  q-symmetric  if  F(z)  =  F^(z).  A  <5-system  polynomial  is  <5- 
symmetric  if  F(c)  ~  F^(c). 


Tabular  forms  of  stability  checking  of  a  polynomial  in  Q'[a;]n  typically  employ  a  sequence 


of  polynomials  each  of  descending  order.  The  first  row  of  such  a  tabular  form  is  denoted 


as  row  the  second  row  is  row  #n  —  1,  and  so  on. 

JT,  MJT  Jury  table  [18],  modified  Jury  table  [15],  [17]. 


real-^-BT 

complex-g-BT 

real-^-BT 

complex-<5-BT 


Bistritz  table  for  ^-system  polynomials  with  real¬ 
valued  coefficients  [11]. 

Bistritz  table  for  ^-system  polynomials  with  complex¬ 
valued  coefficients  [19]. 

Table  form  for  (5-system  polynomials  with  real-valued 
coefficients  [6]. 

Table  form  for  (5-system  polynomials  with  complex¬ 
valued  coefficients  (this  paper). 
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Stability  Determination  of  Two-Dimensional  ^-Systems 

A  ^-system  polynomial  with  all  its  roots  in  Uq  (for  the  1-D  case)  or  Uq  (for  the  2-D  case) 
is  said  to  be  stable.  The  corresponding  regions  for  a  6-system  polynomial  are  Us  (for  the 
1-D  case)  or  (for  the  2-D  case),  respectively. 


2.2.  Review  of  complex-q-BT 


The  complex-6-BT  introduced  in  Section  3  is  based  on  the  complex-^-BT,  and  hence,  we 
briefly  review  it  now.  For  more  details,  see  [10].  Let  the  characteristic  polynomial  of  a 
^-system  be 

n 

F(z)  =  ^  with  .F(l)  €  and  .F(l)  ^  0.  (2-2) 

it=o 


The  complex-^-BT  is  formed  using  the  symmetric  polynomial  sequence  {r(2r)i}”_,o 
where  [19] 


(  Fiz)n  +  FK^U 


T(z)i 


for  i  =  n; 
for  i  =  n  —  1] 

[  (S,+2+Si+^z)T{z)i+,-T{z)i+^^  fori  =  n-2,n-3, 


F(z)„  -  FHz)„ 
2  —  1 


-,0, 


(2.3) 


where 


Si+2  — 


r(0),+2 


^i-l-2) 
^0 _ 


,  z  =  n  —  2,  n  —  3, . . . ,  0. 


(2.4) 


T(0)i+i 

As  in  [11]  and  [19],  equating  similar  powers  on  either  side,  we  may  also  get  the  following 
determinental  rule:  For  A:  =  0, 1, . . . ,  i,  and  i  =  n  —  2,  n  —  3, . . . ,  0, 


1 

r(i+i) 

^0 


ffi+2) 

‘o 

ffH2) 

^k+1 

1 

1 

ffi+2) 

‘'1+2 

ffi+2) 

‘■Jt+l 

^0 

U+1 

U+i 

(2.5) 


Remark.  The  computational  advantage  of  BT  is  due  to  T(z)i  being  ^-symmetric.  This 
implies  \  A:  =  0, 1, . . . ,  i,  and  hence,  it  is  necessary  to  evaluate  only  half  the 

coefficients  of  each  row. 

Using  (12-13),  (16),  and  Theorem  6  of  [19],  we  get 
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Stability  Determination  of  Two-Dimensional  ^-Systems 

Theorem  2.1.  [19]  The  polynomial  F{z)  G  is  ^-stable  iff 

I.  0,  t  =  n  —  1,  n  —  2, . . . ,  0,  and 

II.  Un  =  var{T(l)„,T(l)„_i, . . .  ,T(l)o}  =  0. 

2.3.  Some  results  on  2-D  stability 

Consider  the  2-D  ^-system  transfer  function 

=  (2.6) 

F{Zi,Z2) 

where  E(zi,Z2)  G  3?[zi]„j2:2]n2  a^nd  F(zi,Z2)  €  3?[2^i]ni [^2]n2-  The  2-D  z-transform  is 
taken  using  positive  powers  of  zp  For  a  comprehensive  discussion  regarding  stability  of 
such  systems,  see  [9-10],  and  references  therein.  Hence,  for  reasons  of  brevity,  only  some 
analog  results  applicable  to  2-D  ^-systems  are  provided.  It  is  only  necessary  to  observe 
that  the  corresponding  (^-system  H (01,02)  satisfies 

H{cuC2)  =  =  F(za,Z2)Uc  e  3ft(ci,c2)  (2.7) 

where  £'(ci,C2)  G  3f?[ci]„  Jc2]n2  ^(01,02)  G  3i[ci]njc2]„2.  In  the  remainder  of  this  pa¬ 

per,  we  will  only  be  dealing  with  transfer  functions  H(oi ,  02)  that  are  devoid  of  nonessential 

singularities  of  the  second  kind  on  and  the  pair  E(oi,02)  and  F(oi,02)  is  taken  to  be 

_ 2 

coprime.  If  the  2-D  polynomial  F(oi,02)  ^  0,  V(ci,C2)  G  7/^,  it  is  said  to  be  6-stable.  After 
using  (2.1),  the  following  result  follows  directly  from  [20]: 

Theorem  2.2.  The  2-D  7-system  in  (2.7)  is  7-stable  iff 

I.  F(oi,  — l/r)  7^  0,  Vci  G  Us,  and 

II.  F(ci,C2)  7^  0,  Vci  G  Ts,  Vc2  G  Us- 

The  following  result,  which  allows  one  to  use  the  real-7-BT,  is  directly  from  [21-22] 
after  using  (2.1): 


Theorem  2.3.  The  2-D  7-system  in  (2.7)  is  7-stable  iff 
I.  F{oi,  —l/r)  7^  0,  Vci  G  Us,  and 


stability  Determination  of  Two-Dimensional  ^-Systems 


II.  G(x,C2)  7^  0,  Vx  e  [-2/r,0],  Vc2  G  Us- 
Here  G{x,C2)  =  F(ci, C2)F(ci, C2)  | 

x  =  (ci+Ci 

2.4^  Schur-Cohn  minors 


In  stability  checking  of  2-D  ^-systems,  the  following  result  is  important: 

Theorem  2.4.  [15],  [23-24]  The  polynomial  F{z)  e  S[^]n  is  stable  iff  A,-  >  0,  i  = 
1, 2, . . . ,  n,  where  A,-  is  the  principal  minor  of  the  Hermitian  Schur-Cohn  matrix  f  =  f  *  = 
{7b  }  G  defined  as 

t 

'Yij  ^  t-f-fcQft— j-f-A:  —  hsr  i  ^  j- 

k=l 


Stability  checking  of  2-D  ^-systems  then  involves  positivity  checking  of  all  Schur-Cohn 
minors  Ai(z),  Vf  =  1,2,  ...,n,  V|z|  =  1.  A  necessary  and  sufficient  condition  for  this  is 
positivity  of  Ai(l),  V?  =  l,2,...,n,  and  A„(z),  V|z|  =  1.  This  is  the  simplification  due 
to  [16]  that  has  been  effectively  utilized  in  applying  the  MJT  [15].  The  advantage  of  the 
latter  is  that  its  entries  yield  the  Schur-Cohn  minors  directly.  The  fact  that  complex-^-BT’s 
entries  also  yield  the  Schur-Cohn  minors  was  only  recently  shown. 

Theorem  2.5.  [10],  [25]  The  Schur-Cohn  minors  of  F{z)  are  the  principal  minors  of 
the  (n  X  n)  tridiagonal  Hermitian  matrix 


A  = 


0  irK^-2)K^-3)l 

^  2l-^0  ^n-3  J 


1  r^n~2)  y(n-3). 

2{^n-2  ^0  J 


0  0 
0  0 
0  0 


0  0 
0  0 
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3.  Complex-5-BT 


With  no  loss  of  generality,  consider  the  ^-system  characteristic  polynomial 


Jt=o 


where 


G  3i  and  >  0. 


(3.1) 


(3.2) 


We  now  construct  the  complex-^-BT  with  the  use  of  the  ^-symmetric  polynomial  se¬ 
quence  {^(c),}JLo  where 

f  Fic)n  +  F'^{c)n,  i  = 


nc)i  = 


{6i+2  +  ^»+2(l  +  Tc))T{c)i+i  -  T(c)i+2  •  <-  « 

1  +  Tc  ,  t  n  z. 


(3.3) 


Here 


T(-l/r)i+2  .  non 
^*■+2  =  ,  /_x - ,  ^  =  n  -  2,  n  -  3, . . . ,  0. 


T{-l/r)i+i 

The  normal  conditions  required  to  complete  the  sequence  are 


(3.4) 


T{-^/T)i  7^  0,  i  =  1,2,  1. 


(3.5) 


Remarks. 

1.  To  determine  5-stability  of  i^(c),  one  may  of  course  first  obtain  F{z)  =  i^(c)|c_+^  and 
then  determine  its  ^-stability  by  applying  familiar  stability  checking  algorithms  (e.g.,  BT 
or  MJT).  The  possible  shortcomings  of  such  a  scheme  are  outlined  in  [1]  and  [6].  The 
purpose  here  is  to  obtain  a  direct  check  for  5-stability. 

2.  We  follow  the  work  in  [6]  and  [19],  and  hence,  for  brevity,  all  details  are  omitted. 

3.  The  conditions  T(— l/r),-  =  0,  for  some  i  =  1,  2, ...  n  —  1,  imply  certain  singular  condi¬ 
tions  on  the  root  distribution  of  F{c)  [11],  [19].  The  equivalent  singular  conditions  for  the 
real-5-BT  is  in  [6]. 

4.  Using  5-symmetry,  it  is  easy  to  show  that 

T(-l/r),  =  i  =  0,l,...,n.  (3.6) 
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Therefore 

1 

^'+2  =  *  =  (3.7) 

The  normal  conditions  in  (3.5)  may  now  be  expressed  as 

7^  0,  t  =  n.  -  2,  n  -  3, . . . ,  0.  (3.8) 

Analogous  to  [6],  [11],  and  [19],  we  then  have 

Theorem  3.1.  The  polynomial  F(c)  6  S[c]n  is  stable  iff 

I.  0,  t  =  n  —  1,  n  —  2, . . . ,  1,  and 

II.  =  var{r(0)„,T(0)„_i,...,r(0)o}  =  0. 

One  of  the  main  advantages  of  the  complex-$-BT  is  that  all  computations  may  be 
carried  out  through  real  arithmetic  only  [19].  The  same  holds  true  for  the  the  complex-(5- 
BT  introduced  above  as  well.  To  see  this,  let 

T{c)i  =  S{c)i  +  jA{c)i  with  Si  =  Re[^i]  -f  jlm[^v],  (3.9) 

for  t  =  2,  3, . .  . ,  n.  It  is  easy  to  show  that  »S'(c),’s  and  A(c),  ’s  form  sequences  of  A- symmetric 
and  (^-antisymmetric  polynomials,  respectively.  Now,  (3.3)  may  be  expressed  as 

S(c)i-2  =  r— - —  [Re[^i](2  +  Tc)  ■  S(c)i-i  -f  Im[5i]rc  •  A(c)i_i  -  5(c),] ; 

A(c),_2  =  — - [-Im[6,]rc  •  5(c), •_!  -1-  (2  -f  rc)Re[5i]  •  A(c),_i  -  A(c),-] , 

l  TC 

for  i  =  2, 3, . . . ,  n. 

Remark.  Note  that,  r(0),-  =  5(0),-  -f-yA(O),-  =  5(0)i. 

In  the  real-<5-BT  construction,  a  certain  ‘scaling’  of  {r(c),}"_o  was  useful  [6].  We 
use  the  same  technique  in  the  complex-(5-BT  case  as  well,  thus  providing  the  following 
advantages:  (a)  Terms  containing  r  are  avoided  during  construction,  (b)  Si  and  Vi  may  be 
deduced  by  simple  inspection,  and  thus  (c)  computational  effort  is  reduced. 
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The  sequence  of  polynomials  that  incorporates  ‘scaling’  is  {17(C)i}”=o  where 


-  =  (3.11) 


for  i  =  0, 1, . . . ,  n.  Thus,  from  (3.3),  we  get,  for  i  =  n  -  2,  n  -  3, . . .  0, 


=  (<i+2  +ii+2)ur‘'  -  «.+24-.''  +>41,.  k  = 


(3.12) 


Note  that 


1 

r 


.-7(^+2) 


n  —  2,  n  —  3, . 


(3.13) 


Un  =  var{r(0)i}[Lo  =  var{4*^})Lo- 


(3.14) 


Therefore,  condition  II  of  Theorem  3.1  may  be  checked  by  inspecting  the  constant  coeffi¬ 
cients  of  {I7(C)i}”=o- 

Remark.  One  may  use  the  same  ‘scaling’  strategy  in  an  implementation  that  uses  only  real 
arithmetic. 

Relationship  between  complex-q-BT  and  complex-8-BT 

As  waa  agreed  upon  previously,  given  F{c)n  G  let  us  use  the  notation  F(z)n  to 


indicate 


Fiz)„  =  \F{c), 


(3.15) 


where  A  G  3?  is  a  possible  scaling  constant.  The  establishment  of  the  relationship  be¬ 
tween  the  rows  of  complex-^-BT  of  F{z),  i.e.,  {f{z)i}%Q,  and  complex-(5-BT  of  F(c),  i.e., 
{T(c),  }”3,o,  which  is  the  subject  of  this  section,  is  useful  later  in  obtaining  the  Schur-Cohn 


from  the  latter. 


Claim  3.2. 


F«(z)„  =  XF^ic)n 
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Proof,  Note  that 


F'(z)„  =  z-l’  (i)  =  Az"F(c)„  Az”F 


F“(c)„  ={l  +  TcrF 


1  +  TC 


=  z^F 


1  -  ^ 


The  claim  is  thus  proven. 


Theorem  3.3.  The  rov/s  of  the  complex-^-BT  of  F{z)  and  the  complex-$-BT  of  F{c)  are 


related  by 


T{z)i 


XT{c)i  ,  I  =  n,n  -  2, . . . ; 

c— 

jT(c)i  ,  i  =  n  -  l,n  -  3, - 


Proof.  First,  using  Claim  3.2,  note  that 

f{z)n  =  AT(c)„ 

c— »-z 

Thus,  Theorem  3.3  is  established  for  t  =  n.  i  =  n  -  I  may  also  be  established  directly. 
For  z  n  —  2,  n  —  3, . . » ,  0,  use  (2.3)  and  (3.3).  ® 


Corollary  3.4. 


hi)  _ 
‘■0  ~ 


xFi) 

A  hi) 


for  i  =  n,n  —  2, . . .; 


,  for  ?  =  n  —  l,n  —  3, 

for  i  =  n,n  -  2, . . .; 
\  for  i  =  n  —  1,  n  —  3, 


Proof.  This  follows  directly  from  Theorem  3.3. 
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4.  Schur-Cohn  Minors  for  ^-Systems 


We  now  develop  quantities  that  may  be  considered  the  analogs  of  Schur-Cohn  minors  for 
5-system  polynomials. 


Lemma  4.1.  The  relationship  between  the  complex-5-BT  of  F{c)n  €  &[c]n  and  the  Schur- 
Cohn  minors  A^,  z  =  1, 2, . . . ,  n,  of  F(z)n  G  Q'[z]n  is 


A2 

2r2(n-i+l) 


''n-t 


+  tn-i+l  ^n-i 


A2 

2,-2(n-t+l) 


I  .(n-i-l-l)  ,(n-i)|2 

1+1  ^n~i  I 


Ao  =  1,  Aj  =  0,  i  <  0. 


Proof.  Note  that,  the  relationship  between  the  complex-g-BT  of  F{z)n  and  its  Schur-Cohn 
minors  are  given  by  [25] 


A,- 


1 

2 


V‘0  ^n-i  *'n-«+l  ‘■0 


1  |^n-i+l)Kn-j) 

2  I^Ti  — z+l  ^n  —  i 


with  Ao  =  1  and  Ai  —  0,  i  <  0.  Now,  the  claim  follows  from  Corollary  3.4. 


Let 


D  =  diag 


1  1 

’  j-n—1  ’  ‘  ’ 


Then,  from  Lemma  4.1,  A  in  Theorem  2.5  is  given  by 


(4.1) 


A  =  \'^  - D  A  D 


(4.2) 


where 


2^^n-l  n-2  J 

0 

0 

^n-2  i 

7-  r^n-2)  .(71-3)i 

2  I-  n-2  *'n-3  J 

0 

0 

2^ti-2  ^n-3  J 

0 

(4.3) 

0 

0 

0 

Clearly,  positive  definiteness  of  A  and  A  are  equivalent  statements.  Hence,  we  may 
consider  the  principal  minors  of  A  to  be  the  Schur-Cohn  minors  of  F{c). 
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Definition  4.1.  The  Schur-Cohn  minors  of  F{c)  E  Sy[c]n  are  the  principal  minors  of  the 
tridiagonal  Hermitian  matrix  A  in  (4.3). 

Therefore,  from  Theorem  2.4,  we  have 

Theorem  4.2.  The  polynomial  F(c)  E  Q'fcjn  is  stable  iff  A,-  >0,  i  =  1, 2, . . . ,  where  A^ 
is  the  {i  X  t)-principal  minor  of  A  in  (4.3). 

Remarks. 

1.  Tri diagonal  Hermitian  matrices  constitute  an  important  class  of  matrices  that  have 
been  extensively  investigated  in  matrix  theory  literature  [26].  See  also  [10]. 

2.  Since  the  Schur-Cohn  minor  A,-  obtained  from  the  complex-^-BT  are  necessarily 
proper  [10],  [25],  the  Schur-Cohn  minors  defined  above  for  5-systems  are  proper  as  well. 

In  terms  of  the  ‘scaled’  sequence  of  polynomials  {l/(C)«}iLo)  Theorem  4.2  may  be 
stated  as 


Corollary  4.3.  The  polynomial  F{c)  G  9'[c]„  is  stable  iff  A,-  >  0,  i  =  1,2,  ...,n, 
where  Aj-  is  the  {i  x  z)-principal  minor  of 


A  = 


(4.3) 


Proof.  Using  (3.11),  and  factoring  out  the  appropriate  diagonal  matrices,  the  result  im¬ 
mediately  follows.  ■ 

Remark.  Again,  notice  how  the  use  of  the  ‘scaled’  sequence  simplifies  the  entries. 
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5.  Algorithm  for  Checking  Stability  of  2-D  ^-Systems 


To  check  condition  II  of  Theorem  2.2,  we  may  adopt  the  following  approach: 

(a)  Express  E’(ci,C2)  €  3?[ci]ni [c2]n2  ^  polynomial  in  S>[c2]n2  so  that  its  coefficients,  as 

well  as  the  corresponding  Schur-Cohn  minors,  are  parameterized  by  ci  E  Ts.  Here,  we 
have  assumed  that  ni  >  n2;  otherwise,  the  roles  of  rii  and  n2  may  be  interchanged. 

(b)  Check  positivity  of  each  of  the  Schur-Cohn  minors,  or  positive  definiteness  of  the 

tridiagonal  Hermitian  matrix  A  €  for  all  Ci  E  Tg  (see  condition  II  of  Theorem  2.2 

and  Theorem  4.2).  These  checks  may  be  simplified  by  applying  a  direct  extension  of  Siljak’s 
result  [16]. 

However,  construction  of  the  complex-^-BT  and  the  entries  of  A  require  complex 
conjugation  of  certain  entries  that  are  functions  of  Ci  E  Ts.  This  of  course  complicates  the 
scheme  since  Ci  =  — ci/(l  +  rci),  Vci  E  Ts.  On  the  other  hand,  in  dealing  with  2-D  q- 
system  stability,  we  have  zi  =  1/zi,  V^i  E  Tg.  This  simple  relationship  has  led  to  stability 
checking  schemes  that  use  the  complex  forms  of  tabular  forms  [10]  that  incorporate  the 
polynomial  array  method  [27].  To  circumvent  the  above  difficulty,  the  algorithm  given 
below  uses  the  real-^-BT  in  order  to  check  Theorem  2.3.  In  the  appendix,  an  easily 
implementable  algorithm  that  yields 

G{x,C2)  ^  G{x)n,{c2)2n2  ^  F{ci,C2)F{ci,C2)\  G  3?[x]„,  [c2]2n2  (5.1) 

x  =  (ci+ei)/2 

is  provided.  Note  that 

Cl  G  7^  X  G  [“2/t, 0].  (5.2) 

Before  proceeding,  however,  it  is  important  to  note  that  tabular  methods  are  useful 
in  checking  for  no  roots  to  be  outside  the  stability  region.  However,  since  in  typical  2-D 
stability  studies  the  2-D  transforms  are  taken  with  positive  powers  [9-10],  prior  to  applying 
the  stability  check,  the  following  ^preparation’  must  be  done: 

(a)  Condition  I  in  Theorem  2.3  may  be  checked  by  explicitly  finding  the  roots  or  applying 
the  real-(^-BT  to  ensure 

F»(ci)(-l/r)  =  (l-hTCi)"‘^(^^^)  (-1)  7^0,  Vci  (5.3) 
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(that  is,  polynomial  is  reciprocated  with  respect  to  ci). 
(b)  First  form 


2712 

C?(a:)„i(c2)2n2  =  e  3?[x]„Jc2]2n2 

^=0 


where  G  9i[x]ni 

k=0 


(5.4) 


Here  x  G  [— 2/r,  0].  Now,  condition  II  in  Theorem  2.3  may  be  checked  by  applying  the 
real-5-BT  to  ensure 

2n2 

G(x)ni(c2)2n2  = 

^=0 

=  G(a;)''(c2) 

=  (1  +  rc2)2"2G(x)  (  — ^  0,  Vx  €  [-2/t,  0],  Vc2  €  \  Us 

VI  -f  rc2  / 

(that  is,  polynomial  is  reciprocated  with  respect  to  C2).  Again,  x  G  [— 2/r,  0]. 

We  will  hence  implicitly  assume  that  the  given  2-D  ^-polynomial  has  already  been  ap¬ 
propriately  ‘prepared’  as  above.  In  addition,  the  construction  of  the  real-5-BT  for  G{x){c2) 
requires  ensuring  [11] 

gi^""‘\x)^0  and  92^^^  >  0,  Vx  G  [-2/7-, 0].  (5.6) 

Violation  of  the  first  condition  in  (5.6)  is  equivalent  to 

F(ci)(0)  =  0  for  some  ci  G  T^.  (5.7) 

Assuming,  with  no  loss  of  generality,  >  0  some  x  G  [— 2/r, 0],  violation  of  the 

second  condition  in  (5. 6)  is  equivalent  to 

-^(oi )(  — 1/r)  =  0  for  some  Ci  G  (5.8) 

Therefore,  each  of  these  violations  imply  instability.  Verifying  condition  (5.7)  must  be 
included  in  the  algorithm.  Condition  (5.8)  is  automatically  verified  when  condition  I  in 
Theorem  2.3  is  checked  (see  (5.3)). 


where  G  3t[x]„i 


k=0 


(5.5) 
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Then,  we  have  the  following 

Theorem  5.1.  The  2-D  5-system  in  (2.7)  is  stable  iff 

I.  jF(ci)(  — 1/r)  ^  0,  Vci  G  lie,  and 

II.  F(ci)(0)  +  0,  Vci  €  re,  and 

III.  A,(0)  >0,  Vt  =  1,2, . . .  ,2n2,  and 

IV.  >  0,  Vx  G  [— 2/r, 0],  which  is  satisfied  whenever  0,  Vx  G  [— 2/r, 0], 

together  with  condition  III. 

Here,  A  is  the  Hermitian  matrix  mentioned  in  Theorem  4.2  corresponding  to  G(x)(c2) 
where  x  G  [— 2/r,  0]. 

Conditions  I  and  II  in  Theorem  5.1  are  easy  to  carry  out  (they  may  in  fact  be  verified 
by  explicitly  finding  the  roots).  Condition  III  and  IV  require  construction  of  the  real-5-BT 
and  the  Schur-Cohn  minors  for  which  we  now  develop  polynomial  arrays  [27].  We  also 
provide  a  scaling  scheme  so  that  the  numerical  reliability  of  the  resulting  algorithm  is 
enhanced. 

5.1.  Polynomial  array  for  entries  of  real-6 -BT 
Express  G(x)(c2)  as 

G(x)(c2)  =  - 

where  x("i)  =  [x”Sx"i-i, . . . ,  1]^,  =  [0""% . . . ,  1]^,  and  G 

^(ni-i-i)x(2n2-fi)  -g  coefficient  matrix.  Then,  it  is  easy  to  show  that  [6] 

G{x){c2)  =  ■  G  •  where  G  = 

Here 

^2n2)  _  diaglr^*^^, , . . . ,  1}  G  3[j(2"2+i)x(2n2-i-i). 

p(2«2)  ^  g  3j(2n2  +  l)x(2n2  +  l)  ^  +  l -i  ^ 

The  elements  pij,  which  in  fact  are  those  of  the  Pascal’s  triangle,  are  given  by 

{0,  for  i  <  j] 

1,  for  i  =  j-, 

Pi-1, j-i  +  Pi-1, j,  elsewhere. 
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(5.9) 
=  [91,3]  e 

(5.10) 

(5.11) 

(5.12) 
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The  real-6-BT  is  constructed  using  the  ‘scaled’  polynomial  sequence  in  (3.11-14).  Let 


#(y)(C)  =  G(x)(c2)|c,=-c/.; 

x  =  -yjT 

H{y)(0  =  G(x)«(c2)  I  C,=_c/r  =  Gix){c2)  I  c,=-</.  . 

x--y/r  x^-y/r 


(5.13) 


Note  that,  x  G  [-2/t,0]  iff  y  G  [0,2].  Now,  using  (5.9-12),  row  #2n2  and  2n2  -  1  of  the 
corresponding  ‘scaled’  real-6-BT  are  given  by 


2X12 

U(y)(02m  =  =  H(ym  +  H(y){0 

e=o 

—  ^  p(2n2)^  .  ^2n2). 


C^(y)(C)2n2-l 


2n2~l 

£=0 


H(y)(0  -  H(g)(C) 

-C/t 


_  y(ni)^  .  '(j(2n2)  _  p(2n2)^  . 


■^(2n2-l)- 

0 


where  =  [(2”%  . . . ,  1]'^,  and 

=  diag{(-r)"S(-r)”^-\  . . . ,  1}  G 
j(2n2)  =diag{(-l)2”%(-l)2"=-\...,l}  G  S]fj(2n2  +  l)x(2n2-|-l). 

p(2n2)  ^  ^  g^(2n2-H)x(2n2+l)  ^^leve  p,y  =  (-lj‘+Vi,. 


Each  element  of  the  remaining  rows  is  of  the  form 


u 


“’(v)  = 


n 


(0 


(y) 


d(0(y) 


,  .£  =  0, 1, . . .  ,t,  i  —  2n2,2n2  -  1, ...  ,0, 


(5.14) 


(5.15) 


(5.16) 


where  n[^\y)  €  ^(y)a(O  and  dl6(y)  e  3?[y]^(..).  Substituting  in  (3.12),  it  is  easy  to  show 
that,  for  ^  =  0, 1, . .  . ,  z, 


-  2nr  0  -  *  =  2n2  -  2, . . . ,  O; 

f  1,  for  i  =  2722,2)22  -  1,  (5.17) 

”  (  for  i  =  2)22  —  2, . . . ,  0. 

Note  that  =  nf and  =  i2f''^~^\  Moreover 


a 


(0  = 


(0 


ni, 

C7O+2)  ^ 

O’, 

crO)  -  m. 


for  i  =  2n2 , 2n2  —  1 , 
0+^),  for  i  =  2n2  —  2, . . . ,  0; 

for  i  =  2722,2)22  —  1, 
for  i  =  2n2  —  2, . . . ,  0. 


(5.18) 
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Scaling  scheme.  Let  us  scale  rows  #2n2  and  #(2n2  —  1)  so  that  each  coefficient  takes 
values  in  [—1, 1].  Correspondingly,  for  ^  =  0, 1, . . . ,  z;  i  =  2n2, 2n2  —  L  let 

where  >  0,  z  =  2n2,2n2  —  1,  are  the  scaling  constants  and  [•]  denote  scaled 

quantities.  Note  that 


(5.19) 


^(2n,)  ^  ^(2n,) 


(^(2n2)  ^(2n2)  ^(2n2)  ’ 


(5.20) 


^(2712  —  1)  ^(2n2-’l)  ^(2n2  — 1) 

Now,  substituting  in  (5.17-18),  we  get 


n 


(2712-2) 


-  ^(2n2)/.(2n2-l)  _  „  (2n2-l)x  _  (2n2-l)  (2«2)  ^£-1 

-^2n2  \^e-l  )  ”2n2-l  ;^(2n2);^(2n2-l)  > 


(2n2-2) 


A(2«2)At2"2-l) 

j(2n2-2) 


(5.21) 


..^(2n2)j\(2n2-l)  '  2n2- 

It  can  now  be  seen  that,  it  is  only  necessary  to  compute  the  quantities  on  the  left  hand 
side  of  (5.21).  Then,  one  may  scale  these  to  get 


n 


(2n2— 2)  _  ^(2n2)  J^(2n2  — 1)  J^(2n2— 2)^(2n2— 2) . 


^(2n2-2)  ^  ^(2n2)^(2n2-2)^(2n2-l)J(2n2-2) 


'7 


Note  that 


^(2n2-2)  ^  ^(2„,)^(2„,-2)  ^(2n2-2) 


(5.22) 


(5.2.3) 


^(2n2  2)  ^(2712 ) /y(2n2  2)  ^(2n2 — 2) 

Continuing  in  this  manner,  the  computation  of  the  entries  of  reai-^-BT  may  be  summarized 
as  follows: 

(a)  From  (5.14),  compute  z  =  2^2, 27^2  —  1. 

(b)  From  (5.19),  use  scaling  constants  z  =  2n2,2n2  —  1,  to  get  i  = 

2722,  27Z2  -  1. 

(c)  From  (5.21),  for  £  =  0, 1, . . . ,  z;  z  =  2n2  —  2, . . . ,  0,  compute 


J^'> 

(i)  -  ^b+2  VV-l 

^  =  dl'+2).j((+') 


2n</+'')-A!VT'4''''’  + 


n 


(*) 

f-i 

K(i) 


(5.24) 


r.-(0 


t+i  ’ 
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and  use  scaling  constants  i  =  2n2  ~  2, . . . ,  0,  to  get  \  i  =  2n2  —  2, . . . ,  0. 

Here,  Kn^  and  are  constants. 

(d)  Notice  the  relationships 


n 


(0 


d(') 


^(2n2)^C2n2-2)...^(i)  ? 

^(2n2-l);^(2n2“3)._^(») 

'y(2r»2  —  •♦•^(0  rf(0  ’ 


for  i  —  2n2, 2n2  —  2, . . . ,  0; 
for  i  =  2n2  —  1, 2n2  —  3, . . . ,  1. 


(5.25) 


5.2.  Polynomial  array  for  Schur-Cohn  minora 


Each  Schur-Cohn  minor  obtained  from  the  table,  in  general,  will  be  of  the  form 

Ai(y)  =  ^^e3?(j/),  i  =  l,2,...,2n2, 


(5.26) 


where  N^^\y)  G  §ft[?/]p(i)  and  D^'\y)  G  3J[?/]g(.)-  From  Corollary  4.3,  we  get 

\  f  \  (2n2  — t-fl)  (2n2  — t)  A  1  (2n2— (2n2  — t)^  a  •  a  ^  97^ 

Ai(y)  =  t^2n2-i  ^i-1  -  7’^2n2-i-H  ^2n2-i  A,_2,  i  -  1,  2,  •  .  .  ,  2^2,  (5.2i) 


where  Aq  =  1  and  Aj  =  0,  V^  <  0. 

Remark.  Actually,  as  in  [10],  one  may  show  that,  for  stability  determination  purposes,  only 
the  numerator  polynomials  of  A,-  need  be  computed.  However,  to  contain  the  orders  of  the 
resulting  polynomials,  and  hence  improve  numerically  conditioning,  we  do  not  recommend 
this  scheme. 


Scaling  scheme.  Due  to  the  scaling  of  entries  of  the  real-5-BT,  computation  of  A^,  i  = 
1,2,...,  2n2 ,  may  be  modified  as  follows:  Let 


Ai 


-u 


(2n2) 

2n2 


U 


(2n2-l) 
2n2  —  1 


<^(^22) /y(2n2  —  1)  ^(2712) ^(2n2  —  1 ) 


Hence,  it  is  only  necessary  to  compute  the  quantity 


Ai  A 


(2n2).(2n2-l) 
"'2n2  '^2712-1 

J(2n2)  J(2n2-1) 


(5.28) 


(5.29) 
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Continuing  in  this  manner,  the  computation  of  the  Schur-Cohn  minors  may  be  summarized 
as  follows:  From  (5.27),  for  t  =  1, 2, . . .  ,2n2,  compute 


Ai 


(2n2  — 1+1)  -  (2n2  —  0 
^2n2-t+l  ^2n2-i 

J(2n2-*+l)  J(2n2-0 


Ai-l  +  7 


1 


-0  .c;(2"2-i+l)^(2n.2-i) 


n 


2n'i  —  i+l  t 


4  ..^(2712-0  J(2n2-t+l)  J(2n2-i 


-  A,_2 


(5.30) 


where  Aq  =  1  and  A^  =  0,  Vz  <  0. 


Remark.  Note  that,  since  A,(y)  is  necessarily  a  proper  polynomial  (that  is,. denominator  di¬ 
vides  numerator  properly  with  no  remainder),  and  not  a  rational  polynomial  (see  Remark  2 
after  Theorem  4.2),  it  is  easy  to  see  that  J(2n2-»+i)  J(2n2-.)  divide 
exactly. 


5.S.  Algorithm 

The  following  result,  which  is  the  basis  of  the  stability  checking  algorithm,  is  now  obvious 
from  [10]  and  Theorem  5.1: 

Theorem  5.4.  The  2-D  6-system  in  (2.7)  is  stable  iff 

I.  F(ci,-l/r)  7^  0,  Vci  e  Wi,  and 

II.  F(ci)(0)  ^  0,  Vci  G  Ts,  and 

III.  Ai(0)  >  0,  Vz  =  1, 2, . . . ,  2n2,  and 

IV.  A2„,(y)7^0,  VyG[0,2]. 

The  2-D  stability  checking  algorithm  may  now  be  summarized  as  follows: 


Given. 

A  2-D  6-polynomial  F{cuC2)  G  3^[ci]„i  [c2]„2.  Without  any  loss  of  generality,  cissume 
that  ni  >  ZZ2,  and  express  F(ci,C2)  as  F(ci)n,i(c2)„,. 

Step  I.  Condition  1  of  Theorem  5.4: 

Apply  an  explicit  root  location  procedure.  If  result  is  satisfactory,  proceed;  otherwise, 
system  is  unstable. 

Step  II.  Condition  II  of  Theorem  5.4: 
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Apply  an  explicit  root  location  procedure.  If  result  is  satisfactory,  proceed;  otherwise, 
system  is  unstable. 

Step  III. 

Form  G(y)(c2)  using  the  algorithm  in  the  appendix;  then  form  U{y){C)2n2  and 
U{y){Chn2-i  from  (5.14).  These  yield  and  Of  course,  = 

1. 

From  (5.19),  obtain  and  the  associated  scaling  constants 

and  Of  course,  J0«2)  _  J(2n2-i)  _  i  ^nd  _  x. 

Step  IV.  Condition  III  of  Theorem  5.4: 

Form  Ai(y)  from  (5.30)  and  check  whether  Ai(0)  >  0. 

If  result  is  satisfactory,  form  and  JO'^2-2)  associated  scaling  constants 

A(2”2-2)  and  70«2-2)  fj-oni  (5.24).  Form  A2(y)  from  (5.30)  and  check  whether  A2(0)  >  0. 
If  result  is  satisfactory,  proceed  likewise  until  A2n2(0)  >  0  is  checked.  Note  that,  this  re¬ 
quires  checking  of  only  the  constant  coefficients.  If  result  is  satisfactory,  proceed;  otherwise, 
if  the  check  fails  at  any  i  =  1, 2, . . . ,  2n2,  system  is  unstable. 

Step  V.  Condition  IV  of  Theorem  5.4: 

Apply  an  explit  root  location  procedure  to  check  whether  A2ri.^(y)  7^  0,  Vy  €  [0,2]. 

Remarks.  The  possible  numerical  difficulties  that  may  arise  in  using  explit  root  location 
procedures  may  be  avoided  as  follows:  (a)  Steps  I  and  II  may  be  verified  using  the  real-6- 
BT  [6],  and  (b)  step  V  may  be  verified  by  the  Sturm  sequence  method. 
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6.  Example 


The  stability  checking  algorithm  presented  in  the  previous  section  is  now  illustrated 
through  an  example.  Polynomial  entries  are  denoted  using  a  self-explanatory  shorthand 
notation  where  the  highest  degree  coefficient  is  written  first.  Moreover,  only  four  decimal 
digital  on  the  mantissa  are  shown. 

Consider  the  2-D  polynomial 

■  1  50  740  1 

F{ci,c2)  =  [c\  Cl  1]  52  2700  38480  C2 

[740  38480  547600 J  [l_ 

with  the  sampling  time  r  =  0.1  s. 

Step  I.  Condition  I  of  Theorem  5.4: 

By  applying  an  explicit  root  location  procedure,  one  can  show  that 

F(ci)(-l/r)  =  340c^  -f-  16680ci  4-  236800  ^  0,  Vci  €  Us- 

Step  II.  Condition  II  of  Theorem  5.4: 

By  applying  an  explicit  root  location  procedure,  one  can  show  that 

F(ci)(0)  =  740c?  +  38480C1  +  547600  ^  0,  Vci  G  Ts. 

Step  IIL  Using  the  algorithm  in  Appendix,  we  get 

'1.2800e  +  03  1.2992e  +  05  5.1904e  +  06  9.6141e  +  07  7.0093e  +  08]  rC“' 

G(y)(C)  =  [2/^  y  1]  5.2480e4-04  5.4011e  +  06  2.1662e -f  08  3.9968e  +  09  2.8738e -f  10  ( 

L5.4760e  +  05  5-6950e  +  07  2.2912e -f  09  4.2143e  +  10  2.9987e -h  H  J  Ll. 

After  scaling,  rows  #4  and  #3  are  computed  as  follows: 

=  [1.2859e  -  02,  -5.0693e  -  02,  5.1315e  -  02]; 

=  [-7.9833e  -  02,  3.1991e  -  01,  -3.2798e  -  01); 

4^^  =  [1.9671e  -  01,  -7.9909e  -  01,  8.2798e  -  01]; 

=  [-2.3375e  -  01,  9.5836e  -  01,  -l.OOOOe  -1-  00]; 

=  [1.1687e  -  01,  -4.7918e  -  01,  5.0000e  -  01], 
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with  =  1.1995e  +  12,  and 

nf  ^  =  [-2.4050e  -  02,  9.4053e  -  02,  -9.4595e  -  02]; 

4^^  =  [1.3044e  -  01,  -5.1542e  -  01,  5.2252e  -  01]; 
hf  ^  =  [-2.4703e  -  01,  9.8194e  -  01,  -l.OOOOe  +  00]; 

4^^  =  [1.6469e  -  01,  -6.5463e  -  01,  6.6667e  -  01], 
with  =  5.3490e  +  10.  Of  course,  —  1  with  7^^^  =  7^^^  =  1. 

Step  IV.  Condition  III  of  Theorem  5.4; 

We  get 

Ai  =  [3.0926e  -  04,  -2.4286e  -  03,  7.2184e  -  03,  -9.6217e  -  03,  4.8541e  -  03]. 

Clearly,  Ai(0)  =  4.8541e  -  03  >  0. 

Now,  row  #2  is  computed  as  follows: 

4^^  =  [-8.8619e  -  03,  6.8253e  -  02,  -1.9920e  -  01,  2.6099e  -  01,  -1.2957e  -  01); 
4^^  =  [3.3584e  -  02,  -2.5969e  -  01,  7.6068e  -  01,  -l.OOOOe  +  00,  4.9793e  -  01]; 
4^^  =  [-3.3584e  -  02,  2.5969e  -  01,  -7.6068e  -  01,  l.OOOOe  +  OO]  -4.9793e  -  01], 
with  A(2)  =  4.2420e  -  02.  Also, 

^  [_2.5424e  -  01,  9.9428e  -  01,  -l.OOOOe  +  00], 

with  7^^^  =  9.4595e  —  02.  We  get 

A2  =  [1.8046e  -  07,  -2.8190e  -  06,  1.9343e  -  05,  -7.6148e  -  05,  1.8810e  -  04, 

-  2.9857e  -  04,  2.9737e  -  04,  -1.6992e  -  04,  4.2654e  -  05]. 

Clearly,  A2(0)  =  4.2654e  —  05  >  0. 

Now,  row  ^1  is  computed  as  follows: 

4^^  =  [2.5168e  -  03,  -2.8515e  -  02,  1.3555e  -  01,  -3.4597e  -  01,  S.OOOOe  -  01, 

-  3.8792e-  01,  1.2623e-01]; 

4^)  =  [-5.0336e  -  03,  5.7031e  -  02,  -2.7110e  -  01,  6.9194e  -  01,  -l.OOOOe  +  00, 
7.7584e  -  01,  -2.5246e  -  01], 
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with  3.0980e  -  02.  Also, 

=  [-3.3954e  -  02,  2.6151e  -  01,  -7.6322e  -  01,  l.OOOOe  +  00,  -4.9646e  -  01], 
with  7^^^  =  2.6099e  —  01.  We  get 

Ag  =  [4.0500e  -  10,  -9.3525e  -  09,  9.9260e  -  08,  -6.4020e  -  07,  2.7947e  -  06, 

-  8.6990e  -  06,  1.9797e  -  05,  -3.3188e  -  05,  4.0679e  -  05,  -3.5552e  -  05, 
2.1029e  -  05,  -7.5594e  -  06,  1.2489e  -  06]. 

Clearly,  AsCO)  =  1.2489e  -  06  >  0. 

Now,  row  ^0  is  computed  as  follows: 

n[^'>  =  [-1.0487e  -  04,  1.9379e  -  03,  -1.6174e  -  02,  8.0291e  -  02,  -2.6251e  -  01, 
5.9070e  -  01,  -9.2642e  -  01,  l.OOOOe  +  00,  -7.1104e  -  01,  3.0076e  -  01, 
-  5.7473e  -  02], 
with  =  4.4719e  —  02.  Also, 

J(o)  =  [-6.7946e  -  04,  1.0355e  -  02,  -6.9373e  -  02,  2.6679e  -  01,  -6.4420e  -  01, 
l.OOOOe  +  00,  -9.7458e  -  01,  5.4519e  -  01,  -1.3404e  -  01], 
with  7^°^  =  9.4174e  —  01.  We  get 

A4  =  [4.3531e  -  12,  -1.3058e  -  10,  1.8400e  -  09,  -1.6166e  -  08,  9.9118e  -  08, 

-  4.4970e  -  07,  1.5618e  -  06,  -4.2352e  -  06,  9.0628e  -  06,  -1.5355e  -  05, 
2.0530e  -  05,  -2.1433e  -  05,  1.7129e  -  05,  -1.0130e  -  05,  4.1814e  -  06, 

-  1.0762e-06,  1.3014e  -  07]. 

Clearly,  A4(0)  =  1.3014e  -  07  >  0. 

Step  V.  Condition  IV  of  Theorem  5.4: 

By  applying  an  explicit  root  location  procedure,  one  can  show  that 

^i{y)  /  0,  Vy  6  [0,2]. 

Thus,  we  conclude  that  F{ci,C2)  is  stable. 
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7.  Conclusion  and  Final  Remarks 


In  this  paper,  we  have  developed  an  efficient  stability  checking  algorithm  applicable  for  2- 
D  6-system  characteristic  polynomials.  Our  purpose  here  is  to  obtain  a  direct  algorithm 
due  to  the  possible  numerical  disadvantages  associated  with  indirect  methods  that  utilize 
transformation  techniques. 

In  arriving  at  the  algorithm,  the  following  contributions  have  been  made;  (a)  Tab¬ 
ular  method  of  stability  checking  applicable  for  6-system  polynomials  possibly  possessing 
complex-valued  coefficients,  (b)  quantities  that  may  be  regarded  as  the  Schur-Cohn  minors 
applicable  for  such  systems,  and  (c)  polynomial  arrays  for  computing  both  table  entries 
and  Schur-Cohn  minors. 

The  proposed  Schur-Cohn  minors  lets  one  use  a  Siljak-like  simplification  [16]  in  the 
stability  check.  Although  the  algorithm  utilizes  only  the  real-6-BT,  results  regarding  the 
Schur-Cohn  minors  are  in  fact  valid  for  the  more  general  complex- valued  coefficient  case 
cis  well. 

As  in  [10],  it  is  possible  to  develop  the  algorithm  such  that  only  the  numerator  poly¬ 
nomials  of  the  entries  of  the  real-6-BT  and  the  Schur-Cohn  minors  are  computed.  Then, 
we  do  not  require  polynomial  division  operations.  However,  our  experience  has  been  that 
such  a  scheme  is  prone  to  be  numerically  unreliable.  This  is  mainly  due  to  the  explosion 
of  polynomial  degree  especially  in  computing  the  Schur-Cohn  minors.  To  avoid  these  dif¬ 
ficulties  and  enhance  numerical  reliability,  we  have  (a)  introduced  a  scaling  scheme,  and 
(b)  used  polynomial  division  to  contain  the  polynomial  degree.  The  latter  is  not  new;  in 
fact,  MJT  also  uses  this.  If  the  user  is  interested  in  implementing  the  algorithm  using 
PRO-MATLAB  [28],  these  polynomial  division  operations  may  be  conveniently  performed 
using  the  routine  deconv. 

We  believe  that  a  suitable  scaling  strategy  can  improve  the  numerical  reliability  of 
the  MJT  as  well.  The  authors  are  currently  looking  into  this. 

The  algorithm  developed  is  easily  implementable  on  a  computer.  The  authors  have 
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implemented  it  via  a  C-language  routine  that  the  interested  reader  may  request  from  the 
second  author. 
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Appendix.  Algorithm  to  obtain  G(a:)„i(c2)2„2  from  i^(ci)ni (c2)„2 


Given 

^2  rii 

Fici)n,ic2)n2  =  fe(ci)  •  4  where  /^(cj)  =  ^  A-,£  •  4,  ci  e  Ts,  (a.l) 

^=0  k=0 

we  now  develop  an  algorithm  that  yields 

2n2 

G(a;)„^(c2)2„2  =  '^9j(x)-4  =  ^(ci)ni(c2)n2  ' -^(ci),h(c2)„,,  Cl  G  Ts.  (a.2) 

j=o 

First,  we  see 

n2  n2 

G(x)(c2)  =  £  ■  <4+' 

£=0  jf=0 

n2  tii+i  2n2  J  (a-3) 

=  A(ci)/j-f(ci)  ■  C2  =  X  X  f4ci)fj-e{ci)  ■  4 

e=o  j-t  _,=o  £=o 

(quantities  with  negative  subscripts  are  taken  to  be  zero).  Hence,  comparing  (a.2-3),  we 


get 


where 


^=0 


E 

^=0 


ni  m 


'  c\c\ 


ni 


£=0  LA:=0  i'=0 

n.1 


X  fk,efk,j-e  ■  {cici4  +  X  X  fk,efi,j-t  ■  4c\ 


k=0 


k=0  »=o 

i^k 


J  ni 


e=o  fc=o 


J  rii 


a'  =  EE 


^=0  k=0 


K  m 

E  ■  45!  +  E  ft.'f-.i-l  ■  xf  51 


»'  =  0 
i:f6k 


=  E 


^=0 


rii  k 


i^k 

Til  k 


E  E  ■  xfc'i  +  E  ■  c‘jCi‘ 


=  E 


e^o 


k=0  ‘=0 


ni  k 


kz=:0  ‘=0 

ij^k 


X  X  {fk,efi,j-£  •  Cl  '  +  fz,efk,j-e  ■  4  ')  '  (ciCi)' 


A:=0  *=o 

i^k 


ni  k 


[fk,efi,j-e '  4  + /ij-fA, 


-k  —  i 

e  ■  cj 


k—0  z=0 


^=0 


(a.4) 


(a.5) 
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Let  US  use  the  notation 


^(n)  ^  ^  d  G  Ti,  n  =  0, 1, . . . . 


Noting  that,  for  Ci  6  T5. 


it  is  easy  to  show  that 


Substituting  in  (a.5),  we  get 


1  +  TCi  ’ 


2  (1) 

Cl  Cl  =  — c\  \ 


j  r  ni  fc-1 


^=E  ^  -crcr 


^=0  Lfc=o  1=0 


Substituting  in  (a.4),  we  get 


=  fk,efk,j-e 


e=o  k=o 


(1)'’  (.k-i) 


(a.lO) 


Now,  in  order  to  develop  the  algorithm,  we  need  a  recursive  procedure 

(n) 

pute  Cj  ,  n  =  0, 1,  —  To  proceed,  we  note  that 


to  corn- 


(n)  ^  {Ci+Cx){c^  ^+C"  -CiCi(cp^  +  Cp^) 

j  —  _ 


=  2c(^>  (cmLr^>),n  =  2,3,.... 


(a.li; 


E4? 


(a.l2) 


where 


(a.l3) 


Remark.  Note  that 


c<“'  =  h 


Substituting  (a. 12)  in  (a.ll),  and  equating  similar  coefficients,  we  get 
4,/  =  2  +  -c^i”4^)  ,  z  =  0, . . . ,  n,  n  =  2, 3, . 


(a.l4) 


(a.  15) 
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For  instance, 


n  =  0,l,...,5,  may  be  conveniently  obtained  from 


-1  -]  r  1 

0  1  X 

0  2/r  2 

0  0  6/r  4  a:^ 

0  0  4/r2  16/r  8  a:** 

.0  0  0  20/r2  40/r  16 J  La;^ 
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Two-Dimensional  Delta-Operator  Formulated  Discrete-Time  Systems:  State- 
Space  Realization  and  Its  Coefficient  Sensitivity  Properties 

K.  Premaratne,  Senior  Member,  IEEE,  J.  Suaxez,  Student  Member,  IEEE,  M.M. 
Ekanayake,  Student  Member,  IEEE,  and  P.H.  Bauer,  Member,  IEEE 

Abstract.  Recently,  delta-operator  based  implementation  of  one-dimensional 
discrete-time  systems  has  been  the  focus  of  considerable  research  activity.  This 
is  due  mainly  to  its  superior  finite  wordlength  properties  and  the  possibility  of 
providing  a  unified  treatment  of  both  continuous-  and  discrete-time  systems. 
In  this  paper,  we  investigate  the  delta-operator  formulated  implementation  of 
two-dimensional  discrete-time  systems.  For  this  purpose,  a  local  state-space 
realization  that  is  analogous  to  the  Roesser  model  is  introduced.  Reachability 
and  observability  gramians  and  the  notion  of  a  balanced  realization  for  such 
a  model  are  defined.  Coefficient  sensitivity  properties  of  the  resulting  imple¬ 
mentations,  under  both  fixed-  and  floating-point  arithmetic,  are  also  carried 
out. 
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A 


I.  Introduction 

Current  interest  in  6-systems  is  due  mainly  to  two  reasons:  (a)  6-systems  provide  possess 
superior  roundoff  noise  propagation  (Li  and  Gevers  1993)  and  coefficient  sensitivity  (Li 
and  Gevers  1990,  Premaratne,  et.  al.  1994)  properties,  and  (b)  the  6-operator  makes  it 
possible  to  treat  both  continuous-  and  discrete-time  systems  in  a  unified  manner  since  it 
yields  the  differential  operator  as  a  limiting  case  (Middleton  and  Goodwin  1990,  Vijayan, 
et.  al.  1991). 

Hence,  implementation  of  two-dimensional  (2-D)  and  multi- dimensional  (m-D)  using 
the  6-operator  can  be  expected  to  provide  digital  filters  that  perform  better  in  a  shorter 
wordlength  environment.  If  this  is  the  case,  such  implementations  can  find  widespread  use 
in  real-time  applications,  such  as,  use  of  narrow  bandwidth  filters  with  high  sampling  rates 
where  traditional  ^-operator  implementations  perform  poorly  (Likourezos  1991). 

With  the  above  in  mind,  research  directed  towards  developing  models  for  2-D  and  m- 
D  6-systems  is  warranted.  This  paper  presents  a  local  state-space  model  that  is  completely 
analogous  to  the  well  known  ^-operator  Roesser  model  (Roesser  1975).  We  also  define  the 
notions  of  gramians  and  balanced  realization,  and  with  these  tools  in  hand,  investigate 
coefficient  sensitivity  properties  of  this  model.  Indeed,  implementation  of  2-D  and  m-D 
systems  using  this  Roesser  8 -model,  under  mild  conditions,  is  shown  to  provide  superior 
coefficient  sensitivity  properties  compared  with  the  more  conventional  implementation  of 
Roesser  q-model.  As  usual,  for  notational  simplicity,  we  concentrate  only  on  the  2-D  case, 
the  extension  to  the  m-D  case  being  quite  straight-forward. 

The  paper  is  organized  as  follows:  Section  II  contains  nomenclature  and  some  prelim¬ 
inary  and  a  brief  review  of  relevant  results.  Section  III  contains  the  development  of  the 
Roesser  6-model  and  some  important  system  theoretic  notions.  In  particular,  after  estab¬ 
lishing  the  connection  between  the  gramians  of  one-dimensional  (1-D)  q-  and  6-systems, 
we  define  the  notion  of  gramians  for  2-D  6-systems.  The  relationship  between  these  and 
those  corresponding  to  2-D  ^-systems,  gramian  computation  for  separable  systems,  and  the 
notion  of  a  balanced  (BL)  realization  are  then  presented.  Investigation  of  the  coefficient 
sensitivity  of  the  6-model  is  in  Section  IV.  Addresing  the  more  general  multi-input  multi¬ 
output  (MIMO)  case,  for  this  purpose,  two  sensitivity  measures  applicable  for  fixed-point 
(FXP)  and  floating-point  (FLP)  arithmetic  schemes  are  proposed.  In  the  case  of  FXP 
arithmetic,  we  show  that,  BL  realizations  possess  excellent  coefficient  sensitivity  proper¬ 
ties.  Section  V  contains  an  example.  Section  VI  is  reserved  for  concluding  remarks. 
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II.  Nomenclature  and  Preliminaries 


2.2.  Nomenclature 

3fJ(w)n 

3J(^/i)nh  (t^u)nu 

In 

{o-ij} 

A*,  A'^ 

trace  [A],  A,- [A] 
©,  0 


U  qxp 

IIaIIf 


Real  numbers,  complex  numbers,  and  nonnegative 
integers,  respectively. 

Set  of  matrices  of  size  qxp  over  and  respectively. 

Set  of  univariate  polynomials  of  degree  n  (with  re¬ 
spect  to  the  indeterminate  w  &  over  3i  and  SJ, 
respectively. 

Set  of  rational  univariate  polynomials  of  degree  n 
(with  respect  to  the  indeterminate  w  E  over 
Set  of  bivariate  polynomials  of  relative  degrees  and 
riy  (with  respect  to  the  indeterminates  €  3"  and 
Wy  G  O',  respectively)  over 

Set  of  rational  bivariate  polynomials  of  relative  de¬ 
grees  and  (with  respect  to  the  indeterminates 
Wh  G  O'  and  Wy  G  O',  respectively)  over  3i. 

Unit  matrix  of  size  n  x  n. 

Elements  of  matrix  A. 

Complex  conjugate  transpose  and  transpose  of  matrix 
A. 

Trace  and  z-th  eigenvalue  of  matrix  A. 

Matrix  Kronecker  sum  and  product  operators, 
respectively. 

Unit  vector  in  3?”  with  1  on  the  z-th  row. 

EU  EU  ®  e  S’’ ■ 

Frobenius  norm  of  A. 


In  dealing  with  ^-systems,  the  conventional  indeterminate  z  (with  or  without  a  subscript) 
is  used;  for  ^-systems,  we  use  the  indeterminate  c  (with  or  without  a  subscript).  For  1-D 
systems,  the  transformation  relationship  between  corresppnding  q-  and  ^-systems  is 


.5  = 


q  -  1 


z  —  1 

T 


where  r  is  a  positive  real  constant,  usually  the  sampling  time. 
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For  2-D  systems,  the  subscripts  h  and  v  denote  the  horizontally  propagating  (h.p.)  and 
vertically  propagating  (v.p.)  subsystems  of  the  corresponding  Roesser  local  state-space 
models. 

Tfi,  Ty  Positive  real  constants  denoting  the  ‘sampling  times’ 
along  the  h.p.  v.p.  directions,  respectively, 
e,  S  Tjn,  ©  ryln„  €  ©  Tyln„,  € 

rih,  riy  Integer  valued  symbols  denoting  the  sizes  of  the  real¬ 
ization  of  the  h.p.  and  v.p.  subsystems,  respectively. 

Tt  h  * 

Ici  Iz  C/jJn*  ©  Cvlriu  €  Zhlnh  ©  ^v^n„  €  ^ 


For  2-D  systems,  the  transformation  relationships  between  corresponding  q-  and  ^-systems 
is 


h  = 


Sy  = 


g/t  -  1 
Th 

Qv  1 


Ch  = 


Cy  = 


-  1  , 

n 

Zy  -1 


^-system  quantity  analogous  to  its  corresponding  5-system  quantity  [•]  is  denoted  by  [■]; 
for  example,  state-space  realization  of  a  given  discrete-time  system  is  either  {A,  B,C,D} 
if  implemented  based  on  the  5-operator  or  {A,  B,C ,  D}  if  implemented  based  on  the  q- 
operator. 


H  ,  C„)|  c,,  . 

Cv={zv-^)/tv 

G(Zh,Zy)\ 

z~->c  Zy^  I 

Zy  =1  -f-ry  Cy 

Stability  studies  of  2-D  q-  and  5-systems  involve  the  following  regions: 

U\,  {{zh,Zv)  €  :  \zk\  <  1,  \zv\  <;  1},  {{zh,Zv)  G  : 

\zh\  <  1,  \zv\  <  1},  {{zh.zv)  €  :  \zh\  =  1,  \zv\  =  !}• 

U],  T/  {(c/j,c„)  e  :  \ch  +  l/r/j|  <  1/t/,,  |c„  -f  l/r„|  <  1}, 

{(c/i,c„)  €  :  \ch  +  l/r/i|  <  l/n,  |c„  -|-  l/r„|  <  1}, 

{(c/,,c„)  e  :  \ch  +  I/t/,1  =  1/r/,,  |c„  +  1/t„|  =  1}. 

A  5-system  polynomial  with  all  its  roots  in  Uq  (for  the  1-D  case)  or  (for  the  2-D  case) 
is  said  to  be  stable.  The  corresponding  regions  for  a  5-system  polynomial  are  Us  (for  the 
1-D  case)  and  Uj  (for  the  2-D  case),  respectively. 
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2.2.  Preliminaries 


First,  we  provide  a  brief  introduction  to  the  Roesser  local  state-space  model  applicable  to 
2-D  ^-operator  based  discrete-time  systems  (Roesser  1975). 

Definition  2.1.  The  following  partial  ordering  in  is  used: 

{h,k)<{i,j)  h<i  and  k  <  j] 

{h,k)  =  {i,j)  h  =  i  and  k  =  j] 

(h,k)  <{ij)  ih,k)  <{i,j)  and  {h,k) 


The  2-D  dynamical  systems  under  consideration  are  assumed  to  be  linear,  shift- 
invariant,  and  strictly  causal.  Moreover,  they  axe  taken  to  be  modeled  by  a  set  of  first-order 
vector  difference  equations  over  Given  such  a  p-input  and  g-output  2-D  system,  its  n/ih- 
n„v  Roesser  local  s.s.  model  takes  the  following  form  (Roesser  1975): 


'  qh[x^]{i,j) 

rid)  i(2)- 

’x'‘(f,j)' 

+ 

■5(1)' 

.?v[x1(i,i). 

_i(3)  i(4)_ 

.x"(i,i)_ 

5(2) 

^  rii 

+  [■S]u(z,i); 

x'‘(i,i) 


+  [^]u(bi) 


=  [C] 


x*(i,i) 

x"(bi)J 


+  p]u(f,i), 


(2.1) 


where  u  €  SR?,  E  3?"*,  x"  6  and  y  G  Also,  G  ^ 

j;(3)  g  G  G  3f?”'‘^P,  G  G  3^^^^”'*,  G  3?®^"", 

D  G  and  {i,j)  G  The  operators  and  5„[-]  denote 


9ft[x](i,i)  =  x(i  4- l,i)  and  5,,[x](i,  j)  =  x(i,i -b  1).  (2.2) 

The  s.s.  model  in  (2.1)  is  typically  denoted  by  the  quadruple  {A,B,C,D}.  The  corre¬ 
sponding  2-D  characteristic  equation  and  the  2-D  transfer  function  it  realizes  are  given 

det[Ji  A]  =  det[2/i/n;,  ®  ^vln^  A]  G  3ft[2/i]ri,,  [2u]n„i 
Zy^  =  C(7r  A)  ^B  D  E  3ft(2:/i),i,^(2„),i^, 

where  Zh,Zv  G  In  the  literature,  x^  and  x"  are  referred  to  as  the  horizontally 

propagating  (h.p.)  and  vertically  propagating  (v.p.)  local  state  vectors  of  the  s.s. 
model  {A,B ,C,D}. 
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Assuming  no  nonessential  singularities  of  the  second  kind  on  ,  for  BIBO  stability 
of  the  s.s.  model  above,  it  is  necessary  and  sufficient  that  (see  Jury  1986,  and  references 
therein) 

detf/j  —  A]  ^  0,  V(z/i,2t,)  6  W,.  (2.4) 


For  investigating  coefHcient  sensitivity  properties,  we  will  use  certain  relationships 
encountered  in  Kronecker  products  and  matrix  differentiation.  The  following  are  from 
Brewer  (1978). 

The  derivative  of  A  =  {a,j}  G  3?’^^  with  respect  to  6  €  3?  is 

^  ^  (2.5) 

dh  oh 


Hence 


dA'‘  ^^/daijV 

9i>  94  ) 


The  derivative  of  A  =  [aij]  G  3?^^^  with  respect  to  B  ~  {bk£  G  is  the  partitioned 
matrix  whose  (k^iyth  partition  is  dA/dh^^^  that  is, 

r  . . .  lA.  1 

—  =  :  •.  :  €  (2.7) 


Hence 


2  g  p  s  r 

=  EEEE 

^  i=l  j=l  k=l  i=l 
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III.  State-Space  Model  for  ^-Operator  Implementation 


3.1.  Local  state-space  model 

To  exploit  the  superior  finite  wordlength  properties  of  ^-operator  implementations,  analo¬ 
gous  to  the  1-D  case,  let  us  define  the  operators  and  as  follows. 

.  r  n/-  x(i  4- l,i) -x(i,i)  gA[x](i,i) -x(e,i) 

= - - - = - -  > 

''  ..  .X  (3.1) 

.  r  1/-  -N  x(z',i -M) -x(i,i)  g„[x](^,i) -x(z,i) 

= - ; - = - ;  ’ 

Ty  •  V 

where  r*  and  r„  are  two  positive  real  numbers.  Hence,  the  following  relationships  are 
applicable: 

Sh  —  4  ■!'  Qh  —  Id" 

’■*  j  (3.2) 

6v  —  — -  4=4^  q-o  —  \  TvSy. 


Remark.  When  r*  and  are  the  ‘sampling  times’  corresponding  to  the  horizontal  and 
vertical  spatial  directions,  the  operators  and  6y  in  fact  provide  the  first-order  forward 
Euler  approximants  of  the  derivatives  along  their  corresponding  directions.  When  r/^  ->  0 
and  Ty  — >•  0,  the  operators  6h  and  6y  yield  these  derivatives.  In  the  1-D  case,  this  is 
the  reason  for  the  possibility  of  a  unified  treatment  of  both  continuous-  and  discrete-time 
systems  (Middleton  and  Goodwin  1990). 


With  (3.2)  in  mind,  we  get 


=  e 


-1 


<5/.[x^](i,i) 


Here, 

Using  (3.3)  in  (2.1),  it  is  ezisy  to  get  the  following: 


{qh  l)dnh 

0 

1 

’x*(i,i)' 

0 

(qy  -  l)In„  J 

'9/i[x'‘](bi)' 

=  /n+^ 

.^t-ix^K^i). 

0 

x'*(i,i) 

x”(«,;) 


^/,[x'‘](z,  j) 

■^(1) 

x'‘(i,i)- 

+ 

-Bd)- 

_5„[x’’](i,i) 

ylW  AW 

.x’’(i,i) 

^(2) 

[x’'(^,i)J 

+  [.B]u(z, 

i); 

u(i,i) 


=  [C] 


x'^(i,j) 

Lx^(^,i) 


+  Plu(i,i). 


(3.3) 


(3.4) 


(3.5) 
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In  addition,  as  opposed  to  its  corresponding  ^-operator  implementation,  in  a  5-operator 
implementation,  one  must  perform  the  following  computations: 

+  l,i)  =  -f-  n  • 

x”(i,i  -1- 1)  =  x*'(i,i)  -I-  Ty  ■  5„[x*’](i,i). 

Here, 

A  =  (~^(A  —  In)  A  =  In+iA\ 

B  =  (3.7) 

C  =  c  ^  C  =  C; 

D  =  i)  ^  D  =  D. 

The  size  of  each  submatrix  in  (3.5)  is  equal  to  the  corresponding  submatrix  of  the  realiza¬ 
tion  in  (2.1).  In  the  sequel,  the  realization  {A,B,C,D}  in  (1.1)  will  be  referred  to  as  the 
q-model,  while  the  realization  {A,  H,C,  D}  in  (3.5)  will  be  referred  to  as  the  6-model. 

3.2.  Properties  of  the  5-model 

The  general  response  equation  of  the  5-model  may  be  derived  in  a  manner  that  is  exactly 
analogous  to  that  in  Roesser  (1975).  Hence,  in  what  follows,  only  the  salient  results  are 
given,  detailed  derivations  being  omitted  for  the  sake  of  brevity. 

The  general  response  of  the  5-model  is  given  by 


x'Ci.i)  0  U"(A.i 


^•=o 

(0,0)<(ft,/:)<(i,i)  ^  L  J/ 

y(t.i)  =  lCW  C®1  H-[I>lu(.,j). 

(3.8) 

Here,  refers  to  the  transition  matrix  of  the  5-model.  With  the  partial  ordering  in 
agreed  upon  previously  (Definition  2.1),  it  may  be  recursively  computed  as  follows: 

f  fn  nl  >  for  (i,i)  <  (0,0); 


'  0  0 
[0  oj  ’ 

0 

[  0  In 
A^’^=l\ln,  0] 


’Ad) 

A(2)- 

0 

0 

0 

0 

_a(3) 

A(4) 

[  0  OJ  ^  [  0  0 

0  0 1  ,  -  r  0  0 

_0  I„J  A( 


for  {i,j)  =  (0,0); 
for  {i,j)  =  (1,0); 

for  {i,j)  =  (0,1); 
elsewhere. 
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Remarks, 

1.  =  I  +  ^A  ^  A  =  -  ^)- 

2.  A*-°  =  (A^’°)‘,  Vi  >  1,  and  A®-^  =  (A°-^y,  Vj  >  1. 


The  2-D  ^-model’s  characteristic  equation  and  transfer  function,  and  their  relation¬ 
ships  to  those  of  the  corresponding  g-model  are  as  follows: 


det  [Ic  -  A]  =  det[c;i ©  c„  -  A]  = 


1 


,  *c  £  3?[c/i]n,,  [Cu]n„  ) 

det[^J  (3.10) 


H(^Cli,  Cy^  —  C(^Ic  —  A)  D  —  Zy^\3^—^c  G  5J(c/i)n,^(Cv)n„) 

where 


Ch 


Cl)  — 


''  ''  —  f  ©  '^h^h') 


■Z/t  -  1 

n 

Zy  —  ^ 

<2^17  —  1  “}“  '^yCy  , 


(3.11) 


As  for  the  5-model,  it  is  easy  to  show  that,  2-D  equivalent  transformations  of  the  type 


'x'*(bi) 

■^(i)  0 

[x'‘(i,i)  i 

.x”(i,j)_ 

0 

_ 1 

x"(i,i)J  ’ 


(3.12) 


where  G  and  G  3^'^''^"*'  are  nonsingular,  yield  the  equivalent  2-D  state- 

space  realization  {A,  .B,C,.D}  where 


A  =  TAT-\  B  =  TB,  C  =  CT'^  and  D  =  D.  (3.13) 

The  transfer  function  of  the  realization  {A,  B ,  C",  D}  is  the  same  as  that  for  the  realization 

{A,B,C,D}. 


We  will  also  assume  that 

det[/e-A]^0,  \/{c,,Cy)eul  (3.14) 

Due  to  (2.4)  and  (3.14),  assuming  no  nonessential  singularities  of  the  second  kind  on  Tg  , 
this  implies  BIBO  stability  of  the  2-D  ^-model  (see  Premaratne  and  Boujarwah  1994,  and 
references  therein). 

3.3.  Gramians 

In  the  2-D  5-operator  case,  the  reachability  and  observability  gramians  are  typically  taken 
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to  be  natural  extensions  of  the  integral  expressions  of  their  1-D  counterparts  (see  Pre- 
maratne,  et.  al.  1990,  and  references  therein).  In  order  to  adopt  a  similar  approach  for 
the  ^-operator  case,  we  first  need  to  investigate  the  1-D  gramians  for  the  5-operator  case 
as  defined  in  Middleton  and  Goodwin  (1990). 

1-D  case.  We  quote  the  relevant  definitions  from  Middleton  and  Goodwin  (1990),  p.  194 
and  200; 

Definition  3.1.  (Middleton  and  Goodwin  1990).  Consider  the  1-D  stable  5-system 
{A,B,C,D}.  The  reachability  gramian  P  and  observability  gramian  Q  are  defined  such 
that  they  satisfy  the  following  Lyapunov  equations: 

AP-\-PA*  APA^  =  -BB*] 

A^Q  +  QAAi-  A^QA  =  -C*C. 


We  now  provide  the  integral  representations  of  P  and  Q: 

Lemma  3.1.  Consider  the  1-D  stable  5-system  {^,  B,C,  D}  with  gramians  P  and  Q.  Let 
{A,  .B,C,.D}  with  gramians  P  and  Q  be  the  analogous  1-D  stable  ^-system.  Then 

-I  i*  T 


1 


Moreover 


Q  =  Q  = 


Proof.  Note  that,  A  =  J„  +  i^A,  B  =  ^B,  C  =  C,  and  D  =  D  (Middleton  and  Good¬ 
win  1990).  Substitute  these  relationships  in  the  Lyapunov  equation  for  P  in  Definition  3.1 
to  get 

A*PA*  -  P  =  -tPP*. 


Noting  that  P  must  satisfy 


A*PA*  -  P  =  -BB\ 


we  have  P  =  P/^.  Moreover,  the  integral  expression  for  P  is 
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where  F{z)  =  (zl„  -  A)-^B  (Lu,  et.  al.  1986).  The  claim  regarding  P  now  follows.  The 
proof  regarding  Q  follows  in  a  similar  manner.  * 

2-D  case.  With  Lemma  3.1  in  mind,  we  now  present  the  following 


Definition  3.2.  Consider  the  2-D  stable  ^-system  {A,  5,  C,  D).  The  reachability  gramian 

P  and  observability  gramian  Q  axe  defined  as 

rp(i)  p(2)-|  1  r  ,  dch  dcy 

[p(i)  p(4)J  -  ^  +  1  +  T.c.' 

^  [QW  1  /  N  dch  dcy 

«=  [q(3)  qwJ  - 


where 


F{cii,Cv)  =  {Ic  ~  A)  ,  G  3?  ^(c/i)nh(Ct>)n„) 


Gich,C,)  =  C{Ic-A)-^  ={gl  g2  •••  gn]  e3i‘'^”(c/0n,(c„)„„ 


Remarks. 

1.  Note  that,  fi(cfe,c„)  €  Vi  =  1, . . . ,  n,  and  gj(cfe,c„)  €  Vj  =  l,...,n. 

2.  To  eventually  compare  the  performance  of  the  (J-model  and  its  corresponding  ^-model, 
the  following  relationships  will  be  useful: 


F(^Cii,  Cy')\c—^z  —  ''  ^v)|c— ►z  j 

G(cft,  C„)|c--z  =  gi(c/,,  C„)|c-^z  = 


for  n; 

f  T/igi,  for  i  =  l,...,n/,; 

\  Tygi,  iov  i  —  Uh  +  I,  ■  ■  ■ ,  n. 

(3.15) 


3.  The  above  definition  is  completely  analogous  to  the  1-D  and  2-D  ^-operator  cases.  In  the 
latter  case,  these  gramians  have  been  extremely  useful  in,  and  hence,  have  been  extensively 
used  for,  investigating  coefficient  sensitivity,  roundoff  noise  propagation,  model  reduction, 
etc.  For  instance,  see  Lin,  et.  al.  (1986),  (1987),  Lu,  et.  al.  (1986),  Premaratne,  et. 
al.  (1990),  and  references  therein. 


Lemma  3.2.  Consider  the  2-D  stable  (5-system  {A,B,C,D}  with  gramians  P  and  Q.  Let 
{A,B,C,D}  with  gramians  P  and  Q  be  the  analogous  2-D  stable  g-system.  Then 

P  =  -^P  P  =  TkTyP] 

'^h^v 

Q  = ——iQ^  Q  =  ThT'v^~^Q^~^  ■ 

ThTy 
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Proof.  Consider  the  integral  expression  for  P  in  Definition  3.2.  With  the  variable  change 
c  — »■  z  and  (3.15),  we  get 


P  = 


1  1 
ThTv  (27r;)2 


dzh  dzy 

Zfi  Zy 


However  (Premaratne,  et.  al.  1990), 


^  “  (2^  /  £2  ^v)F*{zh.  Zy) 


dzfi  dzy 
Zh  Zy 


Hence,  the  claim  regarding  P  follows.  The  proof  regarding  Q  is  similar. 


Corollary  3.3.  The  block  matrices  of  the  gramians  are  related  as  follows; 


■p(l)  p(2)  ■ 

p(3)  p(4) 

II 

■p(l)  p(2)' 

p(3)  p(4) 

4=^ 

■p(l)  p(2)' 

p(3)  p(4) 

—  '^h^v 

■p(l)  p(2)' 

p(3)  p(4) 

■Q(i)  Q(2)- 

-^g(l)  Q(2)  ■ 

■g(i)  g(2)' 

■^Q(i)  g(2)  ■ 

_g(3)  (g(4)_ 

S==> 

_Q(3)  g(4) 

/q(3)  ^g(4) 

Proof.  This  follows  directly  from  Lemma  3.2.  ■ 

With  the  above  results  in  mind,  we  now  make  some  pertinent  statements  that  are 
in  complete  analogy  with  the  2-D  5-operator  case.  These  may  be  easily  verified/justified 
from  the  corresponding  results  for  the  latter  (see  Premaratne,  et.  al.  1990,  and  references 
therein) . 


Lemma  3.4.  The  gramians  may  be  represented  as  follows: 

-  00  00 


ThTy  f 


i=0  j>’z=0 
00  00 


Q  =  J_^  .  C*CA^'^  ■ 


1=0  j=0 


where 


Mij  = 


/ 

1  A^-^d^ 

0 

0 

p(2) 

for  (i,j)  =  (0,0); 
for  {i,j)  >  (0,0). 


Lemma  3.5.  Consider  the  2-D  stable  6-raodel  {A,B,C,D}  with  gramians  P  and  Q.  Let 
{A,  J5,  C,  D}  with  gramians  P  and  Q  be  an  equivalent  system  obtained  with  a  nonsingular 
transformation  of  the  type  in  (3.12-13).  Then, 

P  =  TPT*  and  Q  =  T~^'gT"^ 
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Moreover,  the  eigenvalues  of  PQ  are  invariant  under  such  a  transformation. 

Definition  3.3.  The  2-D  (5-model  {A,B,C,D}  is  said  to  be  balanced  if  its  gramians  P 
and  Q  satisfy 

pO)  =  QW  i  s'" 

pW  =  QW  =  sW  = 

If  the  principal  block  diagonal  matrices  of  P  and  Q  are  each  positive  definite,  a  cor¬ 
responding  balanced  realization  may  be  obtained  through  a  simultaneous  diagonalization 
procedure  (Laub,  et.  al.  1987).  Regarding  this,  we  have 

Lemma  3.6.  Local  reachability  and  observability  of  the  5-model  {A.,B,C,D}  and  its 
corresponding  ^-model  {A,  R,  C,  £>}  are  equivalent.  Moreover,  when  {A,  B,  C,  D}  is  locally 
reachable  and  observable,  P^^\  P^'^\  are  each  positive  definite. 

Separable  systems.  A  separable  (in  denominator)  2-D  g-system  has  the  property  that 
=  0  (or,  equivalently,  =  0).  For  such  a  system,  Premaratne,  et.  al.  (1990)  has 
shown  that,  the  off-diagonal  submatrices  of  P  and  Q  are  all  zero.  Moreover,  the  diagonal 
submatrices  may  be  conveniently  computed  through  the  solution  of  two  pairs  of  Lyapunov 
equations. 

From  (3.7),  it  is  clear  that,  a  separable  2-D  g-system  gives  rise  to  a  separable  2-D 
5-system.  Regarding  the  corresponding  gramians,  we  may  state  the  following 

Theorem  3.7.  Consider  the  separable  2-D  5-system  {A,  B,C,  D}  with  gramians  P  and 
Q.  Then, 

p(2)  =  Q(2)=o  and  P(3)^Q(3)^0. 

Moreover,  the  diagonal  block  matrices  of  P  and  Q  may  be  computed  through  the  solution 
of  the  following  two  pairs  of  Lyapunov  equations: 

^(Dpd)  +  pd)^(ir  +^^,4(i)p(i)^(ir  =  .Ipdipdr. 

Tv 

yld)*g(l)  +q(1)^(1)  +^^^(l)*g(l)^d)  =  -i-[Cd)  pd)^(3)  ]*  [  p(4)yl(3)]. 

Tv 

A(4)p(4)  ^  p(4)^(4)*  ^  ^^^(4)p(4)^(4)*  ^_l[p(2)  ^(3)5(1)  j  J  p(2)  ^(3)5(1)]*. 

'^h 

Ad)*Q(4)  ^  g(4)^d)  p^^^(4)*g(4)^(4)  ^  _J_(^(2)-(-(2)^ 
where  pd)  p(4)  _  .j.^.j.^g(4)  _ 
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Proof.  The  results  regarding  the  ofF-diagonal  submatrices  are  obsious  from  Corollary  3.3. 
Regarding  the  diagonal  submatrices,  the  claim  may  be  shown  using  Theorem  3.2.2  of 
Premaratne,  et.  al.  1990.  For  instance,  consider  the  Lypaunov  equation 


i(i)*Q(i)^(i)  _  Qii)  = 

Using  (3.7)  and  Corollary  3.3,  the  second  Lyapunov  equation  in  the  claim  results.  The 
rest  follows  in  a  similar  manner.  ® 
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IV.  Coefficient  Sensitivity 


Coefficient  sensitivity  is  an  important  criterion  on  which  one  state-space  realization  may 
be  preferred  over  another.  In  practice,  effects  of  coefficient  sensitivity  appears  in  the 
system  frequency  response.  Hence,  it  is  important  to  study  the  quantities  dH / dA,  dH / dB, 
dH/dC  and  dH/dD. 

By  generalizing  a  certain  sensitivity  measure  in  Tavsanoglu  and  Thiele  (1984),  Lutz 
and  Hakimi  (1988)  have  addressed  sensitivity  minimization  of  MIMO  1-D  continuous-time 
systems.  The  2-D  g-operator  case  appears  in  Lin,  et.  al.  (1987),  and  references  therein. 
This  work,  applicable  only  to  the  SISO  case,  has  revealed  that  realizations  possessing  mini¬ 
mum  coefficient  sensitivity  are  eqxii valent  to  balanced  (modulo  a  block  orthogonal  similarity 
transformation)  realizations  (see  Premaratne,  et.  al.  1990,  and  references  therein). 

In  what  follows,  we  study  the  coefficient  sensitivity  properties  of  the  2-D  5-model 
introduced  in  Section  III.  Both  FXP  and  FLP  arithmetic  implementations  are  addressed. 
We  follow  a  more  direct  approach  approach  through  the  use  of  Kronecker  product  for¬ 
mulation  and,  as  a  result,  the  results  are  applicable  to  the  more  general  MIMO  case. 
Relationships  regarding  matrix  Kronecker  prodvicts  are  taken  from  the  excellent  treatise  of 
Brewer  (1978)  and,  for  the  readers’  convenience,  where  appropriate,  the  equation  numbers 
of  Brewer  (1978) — these  begin  with  the  letter  T — are  indicated. 


First, 

S^(c,,c„)  =  =  ^|C(/e  -  Ar'B  +  D] 

=  (/„  ®  C]{In  »  (1=  -  ^)-‘l  •  ®  B] 

from  (T4.3)  and  (T5.5) 

=  [In  ®  C{Ic  -  A)-']  •  F„xn  •  [In  ®  (h  '  A)-^  B] 
from  (T2.4)  and  (T5.1). 

Hence 

SA{ck,C,)  =  [In  ®  G]  ■  Unxn  '  [In  ®  F]  E  (4.1) 

Second, 

Ssich^cy)  =  -^H{ch,Cy)  =  -^[C{Ic-  A)~^B  A  D]  = 

dB 

=  [4  ®  G]  •  ^  from  (T4.3). 
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Hence 


Third, 


Hence 


SB{ch,C,)  =  [/„  (g)  G]  •  Unxp  e 


Sc{ch,Cy)  =  ■^H{ch,Cy)  =  -  A)  +  D]  —  —[CF] 

=  |§-[In®F]  from(T4.3). 

Sc{Ch,Cy)  =  U,^n  •  [In  <8>  F]  € 


Fourth, 

Sd(c*,c,)  =  =  A[C(4  -  ^)-iB  +  D] 

- 

~  dD' 

Hence 

SDick,Cy)  =  Ug^pe?it'^"^p\ 


(4.2) 


(4.3) 


(4.4) 


Lemma  4.1  The  quantities  5^(c/,,  c„),  5s(cft,  c„),  Sc(c/i,c„),  and  SD(ch,Cy)  of  the  (5-model 
are  given  as  follows: 


*5'a(^/i)  ^v)  — 


gl 

g2 


[fi*  f; 


f*  • 


Lgn-I 

•S'b(c/i,  c„)  = 

rsS‘> 

gf’ 

gf> 

■■■  gS-’l 
-  sr 

) 

gi"’. 

rf(i)‘ 

*•1 

f(l)‘ 

*2 

f(i) 

'  •  *  An 

« 

Sc{ch,Cy)  = 

f(2)* 

*•1 

f(2)* 

h 

f(2) 

*  *  *  An 

m 

f(?)* 

f(9)* 

fW 

’  ’  ’  An 

* 

‘  -£'1,1 

■£'1,2 

•••  Ei,P 

- 

SoiCh^Cy)  = 

^2,1 

■£'2,2 

•  •  •  ■£'2,p 

- 

Fq,2 

•  •  •  Eq^p 

- 

Here,  denotes  a  {q  x  p)  null  matrix  except  its  j-th  row  which  is  f*,  denotes  a 
(q  X  p)  null  matrix  except  its  j-th  column  which  is  gi,  and  Eij  are  (n  x  p)  elementary- 
mat  rices. 
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Proof.  The  relationship  for  So  follows  immediately  from  (4.4).  To  show  the  remainder, 
note  that 


■F  0  •••  0]  rG  0  •••  O' 

0  F  •.•0  2  0G’'**0  w2 

[In®F]=  .  .  .  e  and  [/„  (2)  G]  =  ;  ;  ;  G  . 

.0  0  •••  f\  Lo  0  G. 

Here,  [/„  (g)F]  and  [J„  ig  G]  each  has  (n  x  n)  blocks.  The  claim  now  follows  through  simple 
yet  tedious  algebraic  manipulations.  ■ 

Corollary  4.2.  The  quantities  5A(cft,c„),  5b(c/i,c„),  5c(c/i,c„),  and  SD{ch,Cv)  of  the 
5-model  and  the  quantities  S^{zh,Zv),  S ^{zh,  Zy),  and  Sf^{zh,Zy)  of  the  corre¬ 

sponding  5-model  are  related  through  the  following: 

‘S'a(^/h  ^v)ic — ►z  ~  ^v'))  ^v)lc — 

‘5'c(^A.?  *'t))|c— ‘Z  ~  3q(^ZIi,  Zyf,  ‘5'£)(c/i  ,  Cu)  |c-* z  ~  ^u)) 

where  H  =  [vkln^g  © 

Proof.  This  is  immediate  when  (3.15)  is  applied  to  Lemma  4.1.  ■ 

To  proceed  further,  we  utilize  the  following 

Definition  4.1.  Let  H{ch,Cy)  be  a  bivariate  matrix-valued  function  that  is  analytic  on 
T/.  Then, 


\\H{cfi,  Cd)||p  — 


{2Trjy 


2  /•27r  /*27r 

Juh^O  Jujv  = 


\\H  (^Cfi  ,  Cy^  |c— ►Z  11  f  d^h  d(jJy 


1 

P 


Remark,  This  matrix  norm  is  extensively  utilized  in  work  related  to  coefficient  sensitivity 
(see  Lin,  et.  al.  1987,  and  references  therein)  due  mainly  to  the  fact  that  it  leads  to  tractable 
results.  This,  and  our  desire  to  make  a  comparison  with  the  corresponding  g-model,  are 
the  primary  reasons  for  its  use  here. 

FXP  Arithmetic  Case 

Assuming  the  actual  implementation  is  carried  out  using  FXP  arithmetic,  we  now  define  an 
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absolute  sensitivity  measure  that  takes  into  account  the  variations  in  the  transfer  function 
H{ch,Cv)  with  respect  to  perturbations  in  A,  B,  C,  and  D  as  follows: 


+ 


(4.5) 


=  l|S..II!  +  i||SBlll  +  i||5clli  +  i||SD||l. 


Remarks. 

1.  The  use  of  different  norms  is  for  mathematical  feasibility  and  tractability,  and  is  typ¬ 
ical  in  coefficient  sensitivity  studies  (Lin,  et.  al.  1987,  Li  and  Gevers  1990).  Given  a 
5-model  {A,B,C,  D},  the  objective  is  to  characterize  those  realizations  belonging  to  the 
class  {A,B,C,D}  =  {TAT~^  ,TB,CT~^  ,D},  where  T  is  a  nonsingular  equivalent  trans¬ 
formation  of  the  type  in  (3.12),  that  minimize  Myxp- 

2.  The  weights  associated  with  each  term  in  (4.5)  may  be  thought  of  as  averaging  factors. 
The  ensuing  measure  then  may  be  thought  of  as  an  average  sensitivity  per  input/output. 

3.  In  a  5-operator  implementation,  due  to  the  necessity  of  performing  the  computation  in 
(3.6),  coefficient  sensitivity  will  be  affected  by  pertmrbation  of  Th  and  Ty  as  well.  Hence, 
Mfxp  niust  be  modified  to  contain  terms  of  the  nature  ||‘S'rfcl|2  s.nd  US'rulla-  However,  the 
selection  of  r/j  and  Ty  may  be  done  somewhat  arbitrarily  so  that  they  possess  exact  binary 
FXP  representations.  If  so,  the  corresponding  sensitivity  terms  may  be  neglected.  In  what 
follows,  we  therefore  assume  that  and  r„  have  been  selected  as  above. 


Now,  we  are  in  a  position  to  attempt  to  obtain  an  expression  for  MpxP  ^.s  follows: 

2 


gi 


< 


Sii 

gi 

gn 


[fl* 


n 


2 

dzh 

dZy 

Zy 

F 

=  trace 


(Stt;) 


dz h  dzy 

,  Zh  Zy 


2  dzfi  dzy 


Zh  Zy 


dzh  dzy 

'  Zh  Zy 
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■  trace 


Cr)l 


C— ►Z 


dzfi  dzy 

Zfi  Zy 


To  get  the  first  inequality,  we  have  used  the  mutual  consistency  of  Frobenius  norm,  that 
is,  1|AB||f  <  \\A\\f  ■  II-SIIF)  and  Cauchy-Schwarz  inequality;  the  last  equality  follows  due 
to  ||A|||.  =  trace[^*A]  (Golub  and  Van  Loan  1983).  Hence,  using  (3.15), 


||5^||f  <  trace[.P]  •  trace[^0^]  =  {rhT^?  •  trace[P]  •  trace[Q].  (4.6a) 


Next, 


gl'’  g',”’ 


L  gn  g»^  J 


dzk  dzy 

Zfi  Zy 


=  p  •  trace 


^  <f  /  P||G(Cft,C„)|c-.z||F— ^  ~ 

(c/i,  Cu)G(C/i,  Ci;)|c 


dzfi  dzy 

Zfl  Zy 


Hence, 

Similarly,  we  get 

and 


||‘S's|l2  =  P  ■  trace[^Q^]  =  pr^Ty  ■  trace[Q]. 
||5'c|l2  =  9  •  trace[P]  =  qrhTy  •  tracefP], 
||Pd112  =P9- 


(4.6b) 

(4.6c) 

(4.6d) 


Remark.  In  a  manner  that  parallels  the  above,  corresponding  to  (4.6),  for  the  ^-system 
counterpart,  we  have 


||5^|li  <  trace[P]  •  trace[Q] 

=  {ruTvY  •  trace[P]  •  tracef^'^Qi^”^]; 
II'^bIIz  =  p-trace[Q] 

=  pThTy  •  trace[^“^Q^“^];(4.7b) 

=  9  •  trace[P] 

=  qrhTy  •  trace[P]; 

H-^dIII  =P9- 


(4.7.a) 


(4.7.C) 

(4.7d) 
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Combining  (4.5)  with  (4.6),  we  get  the  following  upper  bound  for  M-pxP' 

Mfxp  ^  -A^FXP  =  (trace[P]  +  l)(trace[^Q^]  +  1) 

=  {ThTy  ■  trace[P]  +  l){rhT„  •  trace[Q]  +  1). 


(4.8) 


Due  to  difficulties  associated  with  minimization  of  Mpxp,  it  is  customary  to  perform  a 
minimization  of  Mfxp-  Hence,  one  attempts  to  characterize  those  realization  {A,B,C,D} 
that  are  ‘bound  optimal’  with  respect  to  the  sensitivity  measure  Mfxp- 

For  reasons  of  brevity,  we  do  not  attempt  to  perform  this  since  the  procedure  is  exactly 
analogous  to  the  2-D  g-operator  case  (see  Lin,  et.  al.  1987,  and  references  therein).  For 
instance,  one  may  show  that  any  realization  that  is  balanced  modulo  an  orthogonal  non- 
singular  transformation  is  bound  optimal  with  regards  to  the  sensitivity  measure  defined 
in  (4.5). 

Remark.  In  a  manner  that  parallels  the  above,  corresponding  to  (4.8),  for  the  g-system 
counterpart,  we  have 

Mfxp  <  -Mfxp  =  (trace[P]  -f  l)(trace[0]  +  1) 

=  {ThTv  •  trace[P]  -f  l){ThTy  -  trace[^“^(5if”^]  +  !)■ 


However,  it  is  instructive  to  note  that,  compared  to  a  g-operator  implementation,  its 
5-model  implementation  will  always  yield  a  smaller  Mfxp  whenever 

trace[Q]  >  trace[^(5<f] 

(1  -  rl)  ■  trace[Q^^^]  -f  (1  -  r^)  •  trace[Q^^^]  >  0. 

Note  that,  with  the  local  reachability  and  observability  assumption  of  {A,B,C\D}  (and 
hence  {A,B,C,D}),  positive  definiteness  of  and  (and  hence  and 

are  guaranteed.  This  implies  strict  positivity  of  trace[(5^^^]  and  trace[(5^^^]  (and  hence 
trace[(5(^)]  and  tracefQ^"*^]).  Thus,  (4.10)  is  satisfied,  that^is,  the  5-operator  implementation 
is  superior  with  regards  to  coefficient  sensitivity,  whenever 

T/i  <  1  and  Ty  <  1.  (4-11) 


FLP  Arithmetic  Case 

If  the  actual  implementation  is  carried  out  using  FLP  arithmetic,  the  absolute  stability 
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measure  in  (4.5)  may  not  be  the  most  appropriate.  This  is  because,  in  FLP  implementa¬ 
tions,  possible  perturbation  of  a  particular  coefficient  will  be  in  fact  approximately  pro¬ 
portional  to  its  nominal  value.  Due  to  this,  Li  and  Gevers  (1990),  in  addressing  the  1-D 
^-system  coefficient  sensitivity,  utilizes  a  certain  relative  absolute  measure.  In  the  same 
spirit,  a  more  suitable  sensitivity  measure  for  the  FLP  case  will  be 

2 


dH 

'"'dcij 


=  l|5..ll?  +  i||5Bll2  +  i|l&||l  +  i||SDlll 

where  Sa  =  Z)  X)  o-ijdH/daij,  etc.  Using  Definition  4.1,  one  may  now  show  that 

\\SA\\p<\\A\\F-\\SAh-, 

II^bIIp  <  ||B|1f  •  \\Sb\\p] 

115c||.<||C||f-||5c1I,; 

\\Sd\\p  <  II-DIIf  •  \\Sd\\p- 
Hence,  substituting  from  (3.7),  we  get 


(4.12) 


(4.13) 


Mr^FLP  <  iir‘(i-.f)ii"F-li«54ii?+i|ir'B|pF.|ie4ii^+l 

r  1 


(4.14) 


To  proceed  farther,  let  us  assume  =  r  for  convenience.  Then,  we  get 


1 


||r'(2l  - /)||=F  = 

Iie-Blij.  =  i||B|i5.. 

Combining  (4.14)  with  (4.15),  we  get  the  following  upper  bound  for  MpLp: 


(4.15) 


Mflp  <  A/flp  =  11^  —  -^IIf  •  trace[P]trace[(5]  +  HPHf  •  trace[(5]  +  1|C||f  •  trace[P]  +  ||.C)||p. 

_  (4.16) 

Again,  we  perfoi'm  a  minimization  of  Mflp- 

Remark.  In  a  manner  that  parallels  the  above,  corresponding  to  (4.16),  for  the  ^-system 
counterpart,  we  have 


Mflp  <  Mflp  =  |lA||F.trace[P]trace[(5]  +  ||P||F-trace[(5]+||C||F-trace[P]4-||P||F.  (4.17) 


21 


Hence,  compared  to  a  ^-operator  implementation,  its  ^-model  implementation  will 
yield  a  smaller  Mflp  whenever 


||i  -  I\\l  <  llifp.  (4.18) 

Clearly, 

|Ai[il-l|<|Ai[i||,  Vi  =  l,...,n  =>  ||i  - /fp  <  i|ifp.  (4.19) 

where  Aj[A]  denotes  the  z-th  eigenvalue  of  A. 

Remark.  Li  and  Gevers  (1990)  refers  to  the  above  region  (where  the  eigenvalues  of  A 
should  lie)  as  the  Middleton- Goodwin  (MG)  region.  They  show  that,  for  the  1-D  case, 
frequency  response  of  a  ^-system  will  be  less  sensitive  to  coefficient  perturbations  if  the 
system  eigenvalues  lie  within  the  MG  region. 
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V.  Example 


To  illustrate  the  notions  presented  previously,  let  us  consider  the  following  stable  2h-2v 
2-D  digital  filter  in  its  Roesser  model  {A,  J5,  C,jD},  where 

-  1.8890  -0.9122  -1.0000  0  ' 

»  _  1.0000  0  0  ®  .  R 

^  ~  0.0277  -0.0258  1.8890  1.0000  ’ 

.-0.0258  0.0243  -0.9122  0  . 

C  =  [0.1444  -0.0456  -0.1095  0];  D  =  [0]. 

The  magnitude  response  of  this  system  is  shown  in  Fig.  (1).  The  gramians  are  computed 

21.7931  21.3143  0.4100  -0.3848' 

21.3143  21.7931  0.3303  -0.3083 

0.4100  0.3303  0.2836  -0.2589  ’ 

-0.3848  -0.3083  -0.2589  0.2434  . 

2.8358  -2.5893  3.9702  3.0934  ' 

-2.5893  2.4168  -3.7574  -2.8971 

3.9702  -3.7574  159.8513  155.8357  ' 

3.0934  -2.8971  155.8357  159.8513. 

The  similarity  transformation 

-2.1813  -3.6709 

^  _  1.5578  -4.1949 

“  0  0 
.  0  0 

yields  the  BL  ^-system 

-  0.9664  0.1279  -0.4915  0.1932]  r  0.1339- 

^  _  -0.1611  0.9226  -0.1825  0.0718  ,  5  ^  0.0497 

~  0.0463  0.0088  0.9774  0.1747  ’  0.1118  ’ 

.-0.0103  -0.0187  -0.1214  0.9116  J  L  0.3757. 

(76  =  [0.2440  -0.3389  -0.0440  0.0173];  Db  =  [0]. 

Next,  we  attempt  to  obtain  the  corresponding  ^-systems. 


0  0  - 

0  0 

0.4021  -0.1581 

-0.3473  0.2247  . 


FXP  Implementation 

In  FXP,  Th  and  r„  usually  determine  the  range  of  numbers  of  the  (5-system’s  s.s.  represen¬ 
tation.  If  they  are  too  small,  due  to  (3.7),  coefficient  values  in  the  5-system  may  be  too 
large;  if  they  are  too  large,  the  advantages  to  be  gained  in  terms  of  coefficient  sensitivity 
may  vanish.  Hence,  these  parameters  should  be  carefully  selected. 
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By  inspecting  the  BL  5-system,  the  minimvim  value  for  both  and  were  selected 
as  0.5.  The  corresponding  5-system  obtained  then  has  numerical  values  that  axe  within 
approximately  the  same  range  as  for  the  5-system.  Direct  conversion  of  the  BL  5-system 
to  its  correspondiong  5-system  gives 


-  -0.0672 

0.2557 

-0.9830 

0.3864  ■ 

-0.2678- 

-0.3222 

-0.1548 

-0.3651 

0.1435 

;  B  = 

0.0995 

0.0926 

0.0177 

-0.0452 

0.3494 

0.2235 

.  -0.0207 

-0.0374 

-0.2428 

-0.1768. 

.0.7514. 

C  =  [0.2440  -0.3389  -0.0440  0.0173];  £>  =  [0]. 

This  system  is  not  BL  in  the  sense  in  Definition  3.3.  The  BL  5-system  is 


- -0.0672 

-0.2557 

-0.9830 

-0.3864- 

-  0.1894  - 

Ab  = 

0.3222 

-0.1548 

0.3651 

0.1435 

;  Bb  = 

-0.0703 

0.0926 

-0.0177 

-0.0452 

-0.3494 

0.1581 

.  0.0207 

-0.0374 

0.2428 

-0.1768. 

.-0.5313. 

C6  =  [0.3451  0.4793  -0.0623  -0.0245];  A  =  [0]. 


The  BL  5-  and  5-systems  so  obtained  were  implemented  in  finite  precision  using  FXP.  For 
comparison  purposes,  the  following  measures  were  computed: 

£^max  =  and 

N-l 

£^sum  =  2  -  HFXP{e^"^)\\ 

i=0 

where  a;,-  =  2x1/ N  being  a  sufficiently  large  positive  integer,  were  computed.  Here, 
is  the  frequency  response  in  infinite  precision  and  is  the  frequency 

response  in  FXP.  The  results  are  shown  in  Fig.  (2). 

FLP  Implementation 

In  FLP,  a  large  dynamic  range  is  available.  Hence,  there  is  no  restriction  on  the  choice  of 
Th  and  Ty.  We  select  r/i  =  r„  =  1/8.  The  resulting  BL  5-system  is 


- -0.2687 

-1.0230 

-3.9321 

-1.5457- 

-  0.3788  - 

1.2888 

-0.6194 

1.4602 

0.5740 

;  Bb  = 

-0.1407 

0.3704 

-0.0707 

-0.1807 

-1.3975 

0.3161 

.  0.0827 

-0.1494 

0.9710 

-0.7074. 

.-1.0627. 

=  [0.6902  0.9586  -0.1246  -0.0490];  A  =  [0]. 

Again,  the  BL  5-  and  5-systems  so  obtained  were  implemented  in  finite  precision  using 
FLP.  Measures  corresponding  to  Fmax  and  Fsum  were  also  computed.  The  results  are 
shown  in  Fig.  (3). 
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VII.  Conclusion  and  Final  Remarks 


In  this  paper,  we  have  developed  a  5-operator  based  counterpart  to  the  more  conventional 
^-operator  based  Roesser  s.s.  model.  The  motivation  for  such  a  development  lies  in 
the  superior  finite  wordlength  properties  exhibited  by  1-D  5-operator  based  discrete-time 
systems. 

The  corresponding  notions  of  gramians  and  BL  realization  axe  proposed.  For  both 
FXP  and  FLP  implementations,  conditions  under  which  the  5-operator  formulated  system 
behaves  better  than  its  ^-operator  counterpart  axe  derived.  These  results  indicate  that,  in 
most  situations,  the  5-system,  as  expected,  can  be  expected  to  provide  superior  coefficient 
sensitivity  properties. 

In  a  FXP  implementation,  however,  due  to  the  limited  dynamic  range  available,  care 
must  be  taken  in  selecting  the  ‘sampling  times’  and  r„.  Of  course,  in  a  FLP  implemen¬ 
tation,  such  a  difficulty  does  not  arise. 

This  work  only  addresses  the  coefficient  sensitivity  issues.  The  authors  are  currently 
completing  work  regarding  the  roundoff  error  properties  of  the  5-model  developed,  where, 
as  in  1-D  case,  improvements  over  the  corresponding  g-model  are  expected. 

We  must  mention  that  certain  difficulties  regarding  limit  cycles  are  inherent  in  5- 
systems  when  FXP  arithmetic  is  used  (Premaratne  and  Bauer  1993).  However,  this  prob¬ 
lem  is,  for  all  practical  purposes,  nonexistent  in  the  FLP  arithmetic  case.  Hence,  in  om 
opinion,  for  FLP  high-speed  applications,  the  5-model  developed  provides  an  extremely  at¬ 
tractive  solution  that  avoids  the  numrical  ill-conditions  typically  associated  with  g-systems. 
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Abstract  :-The  presence  of  limit  cycles  that  may  arise  in  fixed-point 
arithmetic  implementation  of  a  digital  filter  can  significantly  impair  its  per¬ 
formance,  The  work  in  this  paper  presents  an  algorithm  that  can  be  utilized 
to  determine  the  presence  or  the  absence  of  such  limit  cycles  of  a  given  dig¬ 
ital  filter.  The  filter  is  assumed  to  be  in  its  state-space  formulation  and 
hence,  performance  of  the  corresponding  direct  form  representation  follows 
as  a  special  case.  Moreover,  the  algorithm  is  applicable  independent  of  the 
filter  order,  type  of  quantization  nonlinearity,  and  whether  the  accumulator 
is  single-length  or  double-length.  In  developing  the  algorithm,  bounds  on  the 
amplitude  and  period  of  limit  cycles  of  a  given  digital  filter  are  obtained.  The 
robustness  of  the  algorithm  in  terms  of  limit  cycles  performance  with  respect 
to  filter  coefficient  perturbations  is  verified.  Hence,  it  may  he  utilized  to  ob¬ 
tain  regions  in  the  coefficient  space  where  a  digital  filter  of  given  order  is 
limit  cycle  free. 
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I 


Introduction 


A  digital  filter  may  be  realized  using  either  a  general  purpose  digital  com¬ 
puter  or  special  purpose  digital  hardware.  In  either  case,  the  coefficients 
and  intermediate  results  of  computations  must  be  stored  in  binary  form  in 
registers  of  finite  wordlength.  Limit  cycle  oscillations  are  a  direct  result  of 
this  limitation,  and  care  must  be  taken  to  suppress  them  while  performing  a 
digital  filter  design. 

For  the  past  several  years,  this  in  fact  has  been  a  research  topic  of  inter¬ 
est,  and  a  significant  amount  of  insight  and  research  results  are  now  available 
[1]-[10].  In  an  implementation  of  a  higher  order  digital  filter,  as  shown  in  [11], 
a  cascade  or  parallel  form  composed  of  first-order  and  second-order  subfilters 
is  preferable  over  any  direct  form  realization.  Therefore  the  results  are  sum¬ 
marized  for  the  second  order  realizations.  Most  existing  results  focus  on  the 
effects  of  signed  magnitude  rounding  and  truncation  quantization  schemes 
with  regard  to  the  existence  of  limit  cycles.  Recently,  some  work  addressing 
the  two’s  complement  truncation  scheme  has  also  appeared  [12]- [14]. 

This  work  proposes  an  algorithm  that  may  be  used  to  check  for  limit  cycles 
of  a  given  digital  filter  implemented  using  fixed-point  arithmetic.  It  possesses 
a  wide  scope  of  applicability:  The  digital  filter  to  be  tested  may  be  of  any 
order;  the  quantization  scheme  may  be  arbitrary,  including  truncation  and 
rounding  schemes  corresponding  to  signed  magnitude  and  two’s  complement; 
and  the  accumulator  may  be  of  single-  or  double-length. 

Given  a  digital  filter,  we  develop  bounds  on  the  amplitude  and  period  of 
possible  limit  cycles.  The  algorithm  is  based  on  an  exhaustive  search  proce¬ 
dure  over  all  these  possibilities.  In  addition,  extending  the  same  procedure 
to  the  entire  linear  stability  region,  one  may  utilize  it  to  obtain  regions  in 
the  filter  coefficient  space  where  the  given  filter  is  globally  asymptotically 
stable  (g.a.s.).  For  this  purpose,  the  robustness  of  the  algorithm  in  terms  of 
presence  or  absence  of  limit  cycles  with  respect  to  filter  coefficient  pertur¬ 
bations  is  also  verified.  A  similar  concept  has  been  used  before  for  checking 
limit  cycle  behavior  of  digital  filters  implemented  in  direct  form  [10],  [15]- 
[18].  The  major  advantage  of  the  proposed  method  is  that  it  is  applicable 
for  the  more  general  state-space  implementations.  Of  course,  the  direct  form 
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implementation  then  follows  as  a  special  case. 

The  paper  is  organized  as  follows.  Section  II  contains  the  nomenclature 
used  throughout  the  paper.  Section  III  provides  bounds  on  the  amplitude 
and  period  of  limit  cycles  of  a  given  general  digital  filter.  Section  IV  dis¬ 
cusses  the  algorithm  and  its  computational  aspects.  Section  V  addresses  the 
robustness  of  the  algorithm  with  respect  to  perturbations  of  filter  coefficients. 
Section  VI  contains  some  situations  where  the  algorithm  developed  has  been 
used  effectively.  Finally,  Section  VII  contains  the  concluding  remarks. 


II  Nomenclature 


The  following 
C 

g^mxn  ^vnxn 

3?(-z)mxn 

/€[■] 

dij 

7,0 

x(A:) 

Xi{k) 


Mi 

Mi 

5{k) 

Hiiiz) 


hiiik) 

Pi 

Kii 

r^- 

‘j 


notation  will  be  used  throughout  the  paper. 

Set  of  reals,  set  of  integers. 

Set  of  complex  numbers. 

Nonnegative  integers. 

Set  of  matrices  of  size  m  x  n  over  the  reals  and  integers. 

Set  of  matrices  of  size  m  x  n  over  the  rational  polynomials  in 
the  indeterminate  z  G.  C. 

Cardinality  of  set  [•]. 

(i,  j)-th  element  of  the  matrix  A  =  {0.7}. 

Identity  matrix  and  null  matrix  of  appropriate  sizes. 

Filter  state  vector  at  instant  k. 

f-th  component  of  the  state  vector  x{k). 

The  infinity  norm.  For  x  =  {x,-}  e  JR”*,  ||x|loo  =  max,- 
for  A  =  {a.-j}  G  l|A||oo  =  max,-E”^i  |a, 

Upper  bound  for  absolute  value  of  amplitude  of  x, •(/:),  k  € 
Largest  integer  less  than  or  equal  to  M,-. 

Dirac  delta  function. 

(z,j)-th  element,  that  is,  the  {i,j)-th.  transfer  function,  of  the 
MIMO  transfer  function  H{z).  „ 

Impulse  response  of  Hij{z). 

i-th  pole  (accounting  for  multiplicity)  of  Hij{z). 

Constant  term  in  the  partial  fraction  expansion  of  Hij{z). 
fc-th  residue  of  Hij{z). 


3 


q  Quantization  step  size. 

Q[-\  Quantization  nonlinearity  operator. 

Q  Normalized  quantization  error.  For  instance,  for  roundoff,  q  =  0.5, 

and  for  truncation,  ^  =  1. 

N  Number  of  nonlinearities  in  a  realization. 

e(fc)  Quantization  error  vector. 


Ill  Amplitude  and  Period  Bounds  on  Limit 
Cycles. 


In  general,  the  quantization  nonlinearity  satisfies 

\x  —  Q[x]\<Q-q,  Vx  6  5R,  (1) 

where  q  is  the  normalized  quantization  error.  In  particular,  for  roundoff 
quantization,  g  =  0.5,  and  for  truncation  quantization,  ^  =  1.  Note  that, 
all  the  filter  parameters  may  be  expressed  as  integer  multiples  of  the  quan¬ 
tization  step  size  q.  Hence,  for  convenience,  we  normalize  q  to  unity  for  all 
calculations.  The  quantization  nonlinearity  thus  becomes  an  integer  valued 
function,  viz., 

Q:^-^Z  (2) 

In  general,  for  all  quantization  schemes  of  interest,  Q[0]  =  0. 

We  consider  a  digital  filter  of  order  m  in  its  minimal  state-space  repre¬ 
sentation  {A,B,C,D},  that  is, 

-K{k 1)  =  A  ■  x{k)  +  B  ■  u{k)-,  (3) 

y{k)  =  C  •  yi{k)  +  D  ■  u(A:),  (4) 

where  x  G  3?”*  is  the  state,  u  is  the  input,  an9  y  is  the  output.  Also, 
A  G  3?’"^’".  For  addressing  limit  cycle  performance,  we  consider  the  zero 
input  recursive  state  equation 

x{k  +  1)  =  A  •  x{k).  (5) 
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Unless  otherwise  stated,  we  only  consider  linearly  stable  filters.  Hence,  all 
eigenvalues  of  A  are  inside  the  unit  circle  in  C. 

Now,  under  finite  wordlength  conditions,  the  appearance  of  the  pertinent 
quantization  nonlinearity  in  (5)  may  be  modeled  as 

x(k  +  l)  =  QlA-x(k)].  (6) 

Depending  on  whether  the  result  of  a  product  can  be  stored  with  full  pre¬ 
cision  or  whether  quantization  is  performed  immediately  after  each  product 
is  computed  determines  the  effect  of  this  nonlinearity.  Considering  (5)  and 
noting  that  x(k)  =  {x,}  G  and  A  =  {a.j}  €  we  get  the  following: 

If  the  products  can  be  stored  with  full  precision,  that  is,  if  a  double-length 
accumulator  is  available. 


x(k  -f  1) 


/  QlET=i  ] 


(7) 


V  QIET=1  •  Xj(k)]  ) 

and,  on  the  other  hand,  if  the  product  is  quantized  immediately  after  each 
product  is  performed,  that  is,  if  only  a  single-length  accumulator  is  available, 

/  Q[aii-a;i(A:)]-t-Q[ai2-X2(&)]  +  ...  +  Q[aim*a:m(fc)]  \ 


x{k  +  l)  = 


(8) 


\  Q[am\  •  a:i(A:)]  -f  Q[am2  •  a:2(fc)]  +  •  •  •  +  •  Xm(^)]  / 


Since  q  has  been  normalized  to  unity,  noting  (1),  (7)  and  (8)  may  be 
expressed  in  a  unified  manner  as 

x(fc -h  1)  =  A  •  x(fc) -t- e(A:),  with  |e,-(fc)|  <  iV  •  g,  (9) 

where  e(fc)  =  {e,(A:)}  €  3^*"  and  e,(A;)  G  Note^that,  if  (7)  is  applicable, 
iV  =  1;  if  (8)  is  applicable,  N  =  m. 

We  note  that,  (9)  is  a  description  of  a  linear  system  driven  by  the  bounded 
quantization  error  input  e(fc).  Hence,  we  have  in  fact  converted  the  nonlinear 
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systems  in  (7)  and  (8)  into  the  linear  system  in  (9).  Now,  the  transfer  function 
between  e{k)  and  x(fc)  is 


^  =  (10) 

bj{z) 

where  X  and  E  are  the  z-transforms  of  x  and  e,  respectively.  This,  when 
expanded,  may  be  expressed  as 

^  (  H^z)  Hn(z)  ...  \ 

\  •••  ) 

where  Hij{z)  €  32(2:).  Hence, 

m 

(11) 

i=i 

where  X(z)  =  {X.}  and  E(z)  =  {Ej}.  Taking  inverse  z-transform  of  the 
above,  we  get 


i  =  1,2, . . . ,  m, 
i=i 

where  hij{k)  is  the  impulse  response  of  Hij{z).  Hence 

m  oo 

^i{k)  =  -  r),  i  =  1, 2, . . . ,  m.  (12) 

j=l  r=0 

Combining  (12)  with  the  fact  that  |ej(fc)|  ^  N  •  g,  for  j  =  1,2, we 
obtain 

m  oo 

\xi{k)\<  N  •  Q-'^'^\hij{k)\.  (13) 

j=l  k=0 

Eqn.  (13)  may  now  be  used  to  provide  upper  bouifds  for  each  state  vector  a;,- 
cLS  follows: 

m  oo 

Mi  =  N  ■  g-Y^J2  j  =  1,2,...  ,m.  (14) 

j=l  )i:=0 
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We  realize  that,  in  order  to  estimate  a  useful  upper  bound  for  x,-,  we  need  to 
compute  J2jLi  ^  given  filter.  We  address  this  now.  Consider 

the  transfer  function  Hij{z). 

All  poles  of  Hi j{z)  are  distinct: 


In  this  case,  Hij{z)  may  be  expressed  as 


Hij{z)  -  Kij  +  ^  ^ 


+  ...+ 


Ji _ 


l-Pt'z-'' 


where  €  C  and  Kij  €  9?,  for  =  1,2,  —  ,m.  Taking  the 

inverse  z-transform,  we  have 

hii(h)  =  Kij  ■  S(k)  +  rW[P,'‘')‘  +  , . .  +  >[Pir>]‘, 

where  6{k)  is  the  Dirac  delta  function.  Therefore 


k=0  k=0 

=  \I<ii\  +  |r!‘>l(l  -  +  .. .  +  |r!;>|(l  -  IPir'l)-'. 


This,  when  expanded,  gives 

m  oo  rn 

i=l  k=0  j=l 

m 

+...  +(i-iPir>r'-Ei’-i”’i. 

i=i 

for  i  =  1, 2, . . . ,  m.  Hence 

l»i(t)l  <  N-e-  {Er=.  \Kij\  +  (1  -  IPf’l)-'  •  E"=.  |r!'>|  +  ... 

.••+(i-iPir>r'-E”=,i4”’i},  (15) 

for  i  =  1, 2, . . . ,  m.  Note  that,  convergence  of  the  above  is  guaranteed  due  to 
linear  stability  of  the  digital  filter. 


Remark.  The  method  adopted  in  [10]  tends  to  be  easier  to  implement  and 
more  general  with  regards  to  its  capability  of  handling  the  presence  of  poles 
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of  higher  multiplicity.  However,  our  experience  has  been  that  the  technique 
described  above  often  leads  to  lower  upper  bounds.  Note  that,  the  technique 
in  [10]  utilizes  an  interpretation  that  involves  a  cascade  of  first-order  sections 
to  obtain  a  bound  for  |x,  |;  the  technique  above  utilizes  an  interpretation  that 
involves  a  parallel  combination.  Of  course,  no  one  technique  will  provide  a 
lower  bound  for  all  situations.  If  computer  cost  is  of  concern,  one  can  run 
both  techniques  and  utilize  the  lower  value  of  the  bound. 


Hij{z)  contains  a  pole  with  multiplicity  7; 

Let  this  pole  of  multiplicity  7  be  P.  Then,  Hij{z)  may  be  expressed  as 


Hiiiz)  =  Kij  -h 


+ 


r.(2) 


«j 


(1  -  Pz-i)  '  (1  -  Pz-^y . (1  - 

This  analysis  differs  from  the  one  given  above  for  the  general  term 

JO 


(1  -  Pz-^Y 


where  C  =  2, 3, ... ,7. 


At  this  point,  due  mainly  to  its  ease  of  implementation,  we  utilize  the 
technique  in  [10]  where  the  above  expression  is  interpreted  as  a  cascade  of 
C  first-order  sections.  For  each  first-order  section,  the  inverse  z-transform  is 
taken  using  the  theory  outlined  in  the  distinct  pole  case.  Consider 


„(0 


«) 


r-  ■ 


(1  -  Pz-^Y  (1  -  •  •  •  (1  -  ■ 

Taking  the  inverse  z-transform,  we  get 


(1  -  Pz-i)(l  -  Pz-I)  ...  (1  -  Pz-i) 


=  . 


EI-PI* 


U=o 


=  • 


lC 


This  expression  is  now  substituted  for  the  pole  of  multiplicity  7. 


Lemma  1:  The  zero  input  response  of  the  state  x(l:)  of  the  digital  filter 
described  by  eqn  (7)  or  (8)  is  periodic.  Its  period  T  satisfies 

m 

r<n(2-A  +  i)  (16) 

i=\ 
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where  M,-  is  the  largest  integer  not  more  than  M,-  in  eqn  (14). 

Proof:  Consider  eqn  (7)  or  (8).  The  steady-state  solution  of  each  state  Xi{k) 
will  satisfy 

\xi{k)\  <  Mi,  Vfc,  i  = 

Under  fixed-point  arithmetic,  x(fe)  €  Z”',  and  hence, 

\xi{k)\  <  Mi,  yk,  i  =  l,2...,m. 

A 

Xi(k)  can  therefore  take  only  a  finite  number  of  values,  namely,  (2  •  M,  +  1). 
As  a  result  of  this,  x(fe)  can  take  only  a  finite  number  of  values,  namely, 

m 

IIP  ■  A  +  !)• 

t=l 

Note  that,  the  current  state  vector  x(A:)  uniquely  determines  the  next  state 
vector  x(A:-j- 1)  through  the  function  Q\-\-  Thus,  x(&)  must  be  periodic  in  k. 
Its  period  is  in  fact  bounded  by 

m 

T,„ax  =  n(2-^.  +  l)-  (17) 

t‘=l 

□ 

We  now  have  bounds  on  the  amplitude  as  well  as  the  period  on  the  possible 
limit  cycles.  This  information  will  be  invaluable  for  developing  our  search 
algorithm. 


IV  Algorithm  Description  and  Its  Compu¬ 
tational  Aspects 

In  this  section,  we  formulate  the  theoretical  bci^is  for  the  algorithm  and 
discuss  some  of  its  computational  cispects. 


Definition  1:  The  digital  filter  realization  in  (9)  is  said  to  be  globally  asymp¬ 
totically  stable  (g.a.s.)  if  and  only  if,  for  any  initial  state  x(0)  €  2*"  with 
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||x(0)||oo  <  where  B  €  2+,  there  exists  L  €  such  that  x(fc)  =  0  for 
k>L. 

Remark.  Typically,  g.a.s.  is  taken  to  hold  when  x(A:)  — »  0  as  A:  — > 
oo  (under  the  conditions  above).  However,  due  to  the  finite  wordlength 
available  in  each  register,  the  digital  filter  behaves  as  a  finite  state  machine, 
and  Definition  1  suffices. 


Lemma  2:  Consider  t)  >  0  and  any  initial  state  vector  x(0)  such  that 
|a;,(0)|  <  for  i  =  l,2,...,m, 

with  B{  >  Mi,  for  i  =  1,2,  ...,m.  Then,  there  exists  a  sufficiently  large 
positive  number  jC  such  that  the  digital  filter  in  (7)  or  (8)  satisfies 

|xi(A;)|  <  M.  +  77,  VA:>r, 


for  i  =  1, 2, . . .  ,m. 

Proof:  Since  the  eigenvalues  of  A  are  assumed  to  lie  inside  the  unit  circle 
in  the  complex  plane,  the  digital  filter  in  eqn.  (9)  is  in  fact  g.a.s.  Hence, 
eqn.  (9)  will  yield  a  set  of  nonhomogeneous  linear  shift-invariant  difference 
equations  which  will  have  its  solution  in  two  parts:  A  steady-state  solution 
s{k)  and  a  transient  solution  t{k).  Clearly,  with  g.a.s.,  given  77  >  0,  we  can 
choose  k  sufficiently  large,  say,  k  >  C,  such  that 

max  |t,(A:)|  <  7;,  for  i  =  1, 2, . . .  ,7Ti. 

Since  Mi  G  for  k  >  C,  Mi  rj  will  therefore  act  as  a  true  upperbound 
for  Xi{k)  in  eqn.  (9).  □ 

Hence,  it  suffices  to  check  the  state  vectors  in  the  set  where 

=  {x(A:)  €  2'"||xi(A:)|  <  M.-,  i  =5, 1, 2, . . .  ,m}  ,  (18) 

to  see  if  they  are  mapped  to  the  zero  vector  by  eqn.  (9)  after  a  finite  number 
of  mappings. 


10 


Computational  Aspects 

The  computations  within  the  algorithm  axe  carried  out  in  two  stages. 
Initially,  all  vectors  x(fc)  €  which  map  to  0  in  less  than  Tmax  recursions 
(after  all,  if  limit  cycles  exist,  the  maximum  period  is  Tmax) — are  eliminated 
from  as  they  are  now  known  to  be  stable.  The  remaining  vectors  in 
are  then  further  checked  for  convergence  (see  Section  B). 


Section  A.  Consider  the  set  where 

V(')  =  {x{k)  e  S^°^\Q[A  ■  x{k)]  =  0}  ,  (19) 

Hence,  consists  of  all  the  vectors  x(^;)  €  5^°^  that  map  to  0  in  one  and 
only  one  iteration  of  equation  (7)  or  (8).  Note  that,  any  other  stable  vector  in 
must  map  to  prior  to  reaching  0.  Hence,  for  further  computations, 
we  form 

5(1)  _  5(0)  y(i)^  (20) 

Note  that,  In  fact,  one  immediately  notices  that 

=  Tmax. 

Furthermore,  any  vector  in  which  is  mapped  to  by  (7)  or  (8)  in 
one  iteration  will  also  converge  to  0.  Hence,  we  form  the  set  where 

=  {x{k)  €  .  x{k)]  €  .  (21) 

Hence,  consists  of  all  the  vectors  x{k)  6  that  map  to  0  in  exactly 
two  iterations  of  equation  (7)  or  (8).  Hence,  for  further  computations,  we 
form 

^(2)  ^  ^(1)  \  y(2)_  (22) 

Note  that,  X:[5(2)]  =  -  }C[V^% 

Likewise,  we  get  the  following  sets:  For  L  =  1  ,  2,  .  •  .  ,  Tffiax^ 

=  {x(jt)  G  .  x(k)]  €  ,  (23) 

and 

^{L)  _  ^(L-i)  y  (24) 
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Note  that,  -  ELi 

The  conditions  under  which  this  construction  is  terminated  and  their  impli¬ 
cations  are  as  follows: 


(1)  If 

=  0,  for  some  L  =  1,2,...,  Tmax  —  Ij 

(25) 

all  vectors  in  are  convergent. 

(2)  If 

=  0,  for  some  T  =  1, 2, . . .  Tmax, 

(26) 

then 

=  for  i  =  L,L  +  l,...,Tma.. 

(27) 

Under  this  situation,  the  remaining  vectors  in  5^^“^^-there  are 
them-will  be  further  checked  for  convergence  (see  Section  B). 

of 

Remark.  Upon  a  little  reflection,  one  notices  that  must  either  be 

empty  or  contain  one  and  only  one  vector  from 


Section  B.  Although  the  reverse  mapping  procedure  outline  above  reduces 
the  computational  complexity  considerably,  it  may  not  capture  all  the  vec¬ 
tors  in  T  =  1, 2, . . . ,  Tmax,  that  map  to  0  within  T^ax  iterations.  This 

is  due  to  the  fact  that,  there  may  be  vectors  in  that  map  to  0  through 
a  vector  not  belonging  to  Hence,  when  encountered  with  condition  (2) 
above,  convergence  of  each  remaining  vector  in  is  determined  by  check¬ 

ing  whether  it  is  mapped  to  0  in  less  than  Tmax  through  either  (7)  or  (8), 
whichever  is  applicable.  This  exhaustive  technique  is  in  fact  an  extension  of 
that  given  in  [10]  to  digital  filters  represented  in  their  state-space  realization. 
However,  we  must  emphasize  the  significant  computational  advantage  gained 
by  first  invoking  the  reverse  mapping  construction  procedure  in  Section  A. 

Assuming  condition  (2)  has  occurred,  let 

SW  ^  i  =  1, 2, . . . ,  .  (28) 

Note  that,  when  condition  (2)  has  occurred,  from  (27),  For 

each  vector  6  construct  the  orbit  consisting  of  all  state  vectors 
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xP(i),  for  j  =  1, 2, . . . ,  Tmax,  that  are  consecutively  generated  by  (7)  or  (8) 
(whichever  is  applicable)  with  xj  as  the  initial  state,  that  is,  x,-  =  x,-  (0). 


For  each  i  =  1, 2, . . . ,  the  conditions  under  which  the  construction 

of  each  orbit  is  terminated  and  their  implications  are  as  follows: 

(1)  If 


=  0,  for  some  j  =  1, 2, . . . ,  Tmax, 

(29) 

then 

together  with  each  vector  in  the  orbit  is  convergent. 

(2)  If 

xS^^(j)  =  xS^^(fc),  for  j  ^  k, 

(30) 

then  x^^^  gives  rise  to  limit  cycles.. 


Remark.  These  are  in  fact  the  only  conditions  that  can  occur  when  either 
(7)  or  (8)  generate  the  orbit. 


V  Perturbation  of  Filter  Coefficient  Matrix 


In  constructing  the  region  of  g.a.s.  in  the  coefficient  space,  perturbations 
incurred  in  storing  each  filter  coefficient  must  also  be  considered.  Such  per¬ 
turbations  are  typically  due  to  finite  wordlength  effects  that  require  rounding 
or  truncation  of  the  true  coefficient  value. 

The  algorithm  described  in  the  previous  section  provides  information  re¬ 
garding  g.a.s.  of  a  given  filter  with  a  nominal  coefficient  matrix  A  =  {aij}  € 
Qj^ce  this  is  done,  we  now  consider  a  small  perturbation  Aa.j  of  each 
coefficient  about  its  nominal  value  a,y.  However,  for  a  given  state  vector  x(fc), 
this  perturbation  may  not  necessarily  alter  the  next  state  x(A;  1)  obtained 
since  it  is  entirely  possible  that 

x{k  +  1)  =  Q[{A  -h  AA)  •  x(A:)]  =  Q[A  ■  x(&)],  (31) 

where  AA  =  {Aa.-,}  6 

Depending  on  the  number  of  quantizers  per  row,  that  is,  depending  on 
whether  a  double-  or  single- length  accumulator  is  available,  (31)  is  inter¬ 
preted  differently. 
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Double-length  accumulator 

It  is  evident  that  the  upper  bound  Mi  estimated  for  the  nominal  value  of 
the  coefficient  matrix  {a,j}  G  will  no  longer  be  valid  for  a  perturbed 

system  {a,j  +  Aa.j}  €  .  If  for  a  filter  with  a  nominal  coefficient  matrix 

the  upper  bound  valid  for  all  systems  described  by  the  coefficient 
matrices  {a,j  +  Aa.j},  be  (i/  =  1,2, this  then  could  be  used 
to  estimate  the  robustness  region  as  explained  below.  The  choice  of  is 
critical.  To  determine  the  robustness  region  we  need  an  estimate  for  M^ 
which  will  be  valid  for  all  systems  with  {Aa,j}  perturbations,  an  vise  versa. 
From  eqn.  (32)  we  see  that  Q  can  only  be  determined  after  a  suitable 
is  chosen.  If  the  chosen  is  large  the  region  Q  will  decrease.  If  a  small 
value  for  is  chosen  the  region  Q  will  become  large  and  will  no  longer 
be  a  valid  upper  bound  for  systems  {a,j  +  Aa,j}.  In  such  a  situation  the 
robustness  region  will  be  an  intersection  of  the  computed  Q  and  the  region 
formed  by  {a,j  +  Aaq}  in  the  parameter  space  where  is  still  a  valid  upper 
bound. 

Consider  the  robustness  region 


m 

1  1 

r-  1 

Q  =  {Aa^j\Q 

II 

- 1 

s, 

for  i  =  1,2, ...  ,m,  and  Vx(A:)  €  <?},  (32) 

where 

5  =  |x I  |x„|  <  M,,,  1/ =  1,2, ...,m;  X  € 

Here,  is  an  upper  bound  valid  for  all  filters  described  by  the  coefficient 
matrices  {a.-j  +  Aa,j}. 

Hence  we  can  assume  that  S  is  valid  for  all  systems  described  by  (7)  with 
coefficients  {a,j  +  Aa.j}. 

To  proceed,  it  is  convenient  to  identify  the  discontinuities  associated  with 
the  nonlinearity  Q[-]. 

For  sign-magnitude  roundoff, 

=  6  =  r  +  i,  rG^};  (33) 
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for  sign-magnitude  truncation  quantization, 


D,„,  =  {6,€3«|6r  =  r,  re^\{0}};  (34) 

for  two’s  complement  truncation  quantization, 

'Dtwo  =  {&r  €  1  =  r,  r  €  2} .  (35) 

For  each  x  €  <S,  a  region  Qx  corresponding  to  the  robustness  region  in 
eqn.  (32)  applicable  to  the  pertinent  quantization  schemes  in  (33),  (34),  or 
(35)  is  defined.  Let  the  region  corresponding  to  the  i/-th  state  Xj,  of  x  be 
.  Then,  we  have  the  following: 


For  sign-magnitude  roundoff  quantization. 


'  {Aa,,_,| 

br-i  —  YyjLl  ^  <br 

for  6r-i  <  ^1^3^ j  <  bk  a-nd  r  >  1 

- - 

II 

o> 

{Aa,,j| 

-  ZT^l  aujXj  <  E^=l  <br-  Er=l  <^ujXj}  ^ 

for  br-i  <  Y1T=1  ^  and  r  <  -1 

■{Affl,/j| 

6—1  —  E^i  ^ujXj  <  Ej=i  ^(^i/jXj  <  6o  —  Ej=i 

for  6—1  <C  Ej=i  ^ujXj  ‘‘C  6o  ^ 

where  br  ^ 'Dr] 

for  sign-magnitude  truncation  quantization. 


(  {Aa,/j|  6r-i  ~  <  br  'j 

for  br-i  <  a^jXj  <  bk  and  r  >  2 


= 


^r— 1  ~  Ylj=i  ^  2j=i  Aa„jXj  <  br 

for  br-i  <  Yi%zi  o-vj^j  <  bk  and  r  <  -1 

{Afli/jl  6—1  —  Sj=i  Aa,,jXj  <  64.1  —  52j=i 

for  b—i  <  y^j— 1  di/jXj  <  64.1 

where  br  €  Vmt] 


(37) 
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for  two’s  complement  truncation  quantization, 

cM  ^  I  t  ,  -  5^  ^  . j  . 

V  —  zl/js=l  (^yjXj  K,  bfg  I 

where  6,  €  Vt^^.  (3g) 

"®Sion  can  be  computed  using 
^qns.(36)  ,  (37)  and  (38).  For  all  x  e  5  the  total  robustness  region  is  given 

f]^x-  (39) 

xes 

From  (36)  ,  (37)  and  (38),  we  may  estimate  suitable  values  for  tie  reeion  of 
robustness  for  each  quantisation  scheme.  For  the  twos  complementTunc^ 
tion  quantization  scheme  from  eqn.  (38),  let 


m  f  m 

E  Aa.,x,  <  mm  |6,  -  £  |6...  -  f  u„,x, 

V  J— 1  j=i 

The  left  hand  side  of  (40)  will  be  given  by, 


(40) 


I//* 


i=l 


<  ^|Aa^j|-|zy| 


J=1 


(41) 


true.  eqn. (41)  then  can  be  simplified  to, 


y  Ag^jXj 

|i=l 


m 


^  ^max  * 

i=l 


(42) 


If  we  estimate  the  perturbations  Au.,  such  that 
m  r  m 

Afn.ax  •  E  <  mm  j  |6r  -  E  I^Z-l  "  E 

I  i=i 


i=i 


i=i 


S  ME  ■  “Jl  P'  -  S  “ri-l  l.  |Sr-.  -  l;a.,X,| 

v  i=i 


(43) 

(44) 
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Using  the  approximation  in  eqn.  (44)  we  can  estimate  a  region  Q,  where  Q  is 
given  by, 


Q  —  {Aa^/jl  ||Aa,/j||i  < 

•  “  YyjLi  l^r-i  Y^j=i 


(45) 


Clearly,  Q  (ZQ. 

From  eqn.  (45)  it  is  observed  that  in  a  degenerate  case  Q  may  only  contain  the 
zero  perturbation  vector.  Generally  not  all  perturbations  Aaj,j  are  zero.  To 
find  the  region  of  robustness  for  the  sign-magnitude  truncation  and  roundoff 
schemes  a  similar  analysis  can  be  cajried  out. 

In  the  case  of  sign-magnitude  roundoff, 

m  1  1 

|6r— 1  'y  ",  9 

i=i  i=i  J 

Then  the  maximum  perturbation  region,  Qmax  is  given  by, 

^max  =  I Aa„j I  II Aa^^j 111  <  i/  =  l,2...,m|  (47) 

Where  Mi,  for  =  1, 2 . . . ,  m  are  the  upper  bounds  computed  for  the  nominal 
value  {oij}.  Since  Mmax  ^  M^  >  Mi,  ,  Q  C  Cmax-  Therefore  eqn.  (47)  can 
be  used  to  obtain  a  valid  upper  bound  in  this  case. 

To  compute  the  region  described  above  requires  a  complex  algorithm,  the 
computation  load  can  be  greatly  reduced  by  following  the  guidelines  given 
below. 

Initially  if  vectors  with  comparatively  higher  upper  bounds  are  used  in 
the  computation,  the  robustness  region  will  initially  converge  fcister  and  the 
number  of  added  vertices  to  the  formation  of  the  total  region  will  be  very 
little  due  to  vectors  with  comparatively  lower  upper  bounds.  It  is  observed 
from  eqn. (32)  that  when  the  upper  bound  is  small  the  region  described  by  Q 
tends  to  become  larger. 


min  <  |6r  — 
xe5 
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Observation: 

If  Mv  <  1  for  all  V  we  observe  that  S  will  only  contain  0.  It  follows  that  for 
a  digital  filter  implementation  given  by  eqn.  (7) 

m  oo 

i=l  Jk=0 


for  j/  =  1, 2 . . .  ,m 
Since, 

m  oo 

EEI'‘oWI>l  (49) 

J=1  k=0 

Eqn.  (48)  can  only  be  satisfied  if  ^  <  1.  For  sign  magnitude  roundoff  quan¬ 
tization  ^  =  1/2,  therefore  from  eqn.  (48), 

m  oo 

E  E  l'•o(*)l  <  2  (50) 

j=l  fc=0 

Therefore  we  conclude  that  a  digital  filter  in  double  length  accumulator  en¬ 
vironment  satisfying  eqn.  (50),  is  globally  asymptotically  stable. 


Single-length  accumulator 


If  there  are  m  quantizers  per  row  as  in  (8),  robustness  region  is  defined 
in  the  following  manner: 


r 

m 

m 

Aaij\Q 

=  Q 

*  ^j) 

Vx€5i 


1 


•  (51) 


As  in  the  double  length  accumulator  implementation  we  define  a  upper  bound 
valid  for  all  systems  given  by  eqn.  (8),  and  define  a  set  S\. 


S\  =  |x  |a;,-  <  Mi]  i  =  1, 2, . . . ,  m;  x  €  (52) 

Where  Mi  is  an  upper  bound  valid  for  all  filters  described  by  the  coefficient 
matrix  {a,-,-  -f-  Aoi,}.  Let  the  robustness  region  corresponding  to  element  a,y 

/  •  ♦X 

in  the  coefficient  matrix  for  a  particular  state  vector  x  be  •  Then,  we 
have  the  following: 
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For  sign-magnitude  roundoff  quantization, 


gVJ)  = 


{Acjjl  br-i  -  Oij  •  Xj  <  Aoij  •  Xj  <br-  Oij  •  Xj} 

for  br-1  <  aij  •  Xj  <bk  and  r  >  1 

^ij  *  Xj  ^  ^^CLij  *  Xj  ^  b^  ^ij  *  } 

for  br-i  <  aij  •  Xj  <  bk  and  r  <  —  1 

b — 2  ■*“  a^j  *  Xj  ^iaij  *  Xj  &0  ”*  ^ij  *  } 

for  6_i  <  a,j  •  Xj  <  bo 
where  br  €  'Dr,,  Vx  €  Si", 


for  sign-magnitude  truncation  quantization, 


ew)  = 


br—i  ~~  aij  *  Xj  ^^aij  ■  Xj  "  ^j} 

for  6r-i  ^  and  r  >  2 

1  aij  •  Xj  ^  ^^aij  •  Xj  ^  br  ~~  aij  • 

for  6r-i  <  aij  •  Xj  <  6jk  and  r  <  —  1 
{Aa.jl  6_i  —  a,j  •  Xj  <  Aa.j  •  Xj  <  b+i  —  aij  -Xj] 

for  6_i  <  aij  •  Xj  <  b+i 
where  br  €  D^t  Vx  6  Si 


For  two’s  complement  truncation  quantization, 

^r— 1  ^ij  ■  ®j  ^  Aaij  •  Xj  ‘‘C.  br  aij  •  Xj} 

^  \  for  6r-i  <  Oii  ■ 

where  br  €  'Ptwo  Vx  € 

Hence  g.a.s.  can  be  gaurenteed  for  the  region 

6  =  n  ej'''. 
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Using  a  similar  argument  as  in  the  case  of  a  double-length  accumulator, 
we  can  estimate  a  region  of  robustness  for  each  quantization  scheme.  The 
estimated  region  for  the  sign  magnitude  roundoff  will  be  given  by, 


(57) 


VI  Some  Examples 


In  this  section  the  proposed  search  algorithm  is  applied  to  a  dense  grid  in 
the  coefficient  space  to  obtain  the  total  global  asymptotic  stability  region 
for  a  digital  filter  with  zero  input.  The  dense  grid  will  provide  a  reasonably 
good  approximation  to  the  g.a.s  region,  since  it  is  not  possible  to  consider  all 
points  in  the  linear  stability  region.  Note  that  each  point  in  the  coefficient 
space  is  associated  with  a  neighborhood  where  the  filter  is  stable.  A  10  Bit 
wordlength  is  assume  for  all  computations,  therefore  the  filter  coefficients 
are  quantized  to  a  multiple  of  Within  the  linear  stability  region  dark 

areas  indicate  points  where  limit  cycles  of  some  period  exists.  It  should  be 
noted  that  the  linear  stability  region  does  not  have  a  common  boundary 
with  the  global  asymptotic  stability  region  obtained  through  this  algorithm. 
Therefore  in  all  figures,  the  boundary  line  which  delimits  the  stability  region 
from  the  unstable  region  does  not  belong  to  the  stability  region. 

The  most  commonly  encountered  quantization  schemes  are  analyzed,  they 
are  namely,  sign  magnitude  roundoff  quantization  scheme,  sign-magnitude 
truncation  quantization  scheme  and  the  two’s  complement  truncation  quan¬ 
tization  scheme.  In  all  quantization  schemes  the  single-  and  the  double-length 
accumulator  implementation  results  are  provided.  All  results  are  provided 
for  the  {a,j}  €  coefficient  matrix.  All  existing  results  for  the  named 

quantization  schemes  were  verified.  For  a  direct  form  digital  filter  in  state 
space  formulation  (the  coefficient  matrix  is  given  by  eqn.(58) 


Figure.(la)  shows  the  region  obtained  by  the  proposed  algorithm  the  sign 
magnitude  roundoff  quantization  scheme  in  an  double  length  accumulator 
environment. 


(a)  I  .  .  . 

Figure  1:  Region  where  a  direct  form  digital  filter  is  limit  cycle  free  for  cases 

(a)  Double  length  accumulator,  (b)  single  length  accumulator 


The  region  obtained  is  identical  to  the  results  given  in  [10].  For  the  same 
quantization  scheme  and  single  length  accumulator  the  region  obtained  is 
given  in  Figure.(lb).  The  region  matches  exactly  with  the  ones  found  in  [lOj. 
The  regions  for  the  two’s  complement  and  the  sign  magnitude  truncation 
schemes  were  also  verified.  The  regions  obtained  by  the  proposed  algorithm 
matches  with  the  regions  given  in  [10]. 

Results  for  minimum  norm  realization  of  digital  filters  . 


Figure  2:  The  region  where  a  minimum  norm  realization  of  a  digital  filter  is 
free  of  limit  cycles  for  double-  and  single-length  accumulator  environments, 
(a)  sign  magnitude  roundoff  (b)  sign  magnitude  Ty^ncation 


The  stability  of  digital  filters  in  its  minimum  norm  form  for  the  coefficient 
matrix,  {a,j}  €  case  was  also  investigated.  The  coefficient  matrix  is 
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given  by  eqn.(59). 


The  results  for  the  sign  magnitude  roundoff  scheme  for  the  single-  and  the 
double-length  accumulator  environment  is  given  in  Figure.  (2a)  This  region 
matches  with  the  region  given  in  [7].  The  stable  region  for  the  sign  mag¬ 
nitude  truncation  scheme  in  a  single  length  or  double  length  accumulator 
environment  spans  the  entire  region  where  cr^  +0;^  <  1.  results  are  given  in 
Figure. (2b).  This  supports  the  results  obtained  in  [  ]. 

For  the  two’s  complement  truncation  quantization,  with  double  length 
accumulator  the  global  asymptotic  region  is  given  in  Figure.  (3a).  This  sup¬ 
ports  and  also  improves  on  the  previously  known  results  given  in  [19].  To  the 
authors  knowledge  no  previous  results  are  available  for  the  two’s  complement 
truncation  quantization  in  a  single  length  accumulator  environment.  The  re¬ 
gion  of  global  asymptotic  stability  is  summarized  in  Figure.(3b).  Note  that 


(a)  (b) 


Figure  3:  Region  where  Two’s  complement  truncation  implementation  of  a 
minimum  norm  digital  filter  is  limit  cycle  free  (a)  Single  length  accumulator 
(b)  double  length  accumulator 

for  the  Two’s  complement  quantization  scheme  in  a  double  length  accumu¬ 
lator  environment,  series  of  points  extend  from  the  stability  region  into  the 
instability  region  such  that, 

cr  <  0  and  ur  =  ±cr  (60) 

The  following  coefficient  matrix  can  be  cited  as  an*example, 

■  672  672  - 

1024  1024 

A  =  (61) 

672  672 

1024  1024  - 
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Conclusion 


A  new  algorithm  capable  of  determining  global  asymptotic  stability  of  any 
fixed  point  digital  filter  represented  in  its  state  space  formulation,  under  zero 
input  conditions  has  been  presented.  The  search  algorithm  is  independent 
of  the  type  of  nonlinearity,  the  number  of  nonlinearities  and  it  has  been 
generalized  to  handle  a  digital  filter  of  order  m  in  its  state  space  represented 
form. 

The  proposed  algorithm  is  found  to  provide  tighter  bounds  on  the  ampli¬ 
tude  of  limit  cycles  in  most  cases,  and  it  will  always  determine  the  stability 
or  instability  of  a  particular  digital  filter.  Significant  improvement  over  the 
existing  results  for  the  two’s  complement  truncation  schemes  in  both  single- 
and  double  length  accumulator  environments  have  been  presented. 

The  current  research  is  directed  towards  the  following  problems. 

(1)  Establishing  regions  within  which  limit  cycles  of  a  pre-specified  period 
exists. 

(2)  Establish  regions  within  which  limit  cycles  that  are  under  a  pre-specified 
bound  exist. 

(3)  Extension  of  the  algorithm  for  5-operator  formulated  systems.  In  Fixed- 
point  arithmetic  it  is  known  that  such  systems  always  exhibit  limit  cycle 
behavior  [20].  Therefore  in  actual  applications  the  regions  similar  to  the 
ones  mentioned  in  items  (1)  and  (2)  may  be  of  importance. 
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ABSTRACT 

In  this  paper,  the  problem  of  global  asymptotic  stability  of  <5-operator  formulated  one¬ 
dimensional  (1-D)  and  multi- dimensional  (m-D)  discrete-time  systems  is  analyzed  for  the 
case  of  fixed  point  implementations.  It  is  shown  that  the  free  response  of  such  a  sys¬ 
tem  tends  to  produce  incorrect  equilibrium  points  if  conventional  quantization  arithmetic 
schemes  such  as  truncation  or  rounding  are  used.  Explicit  necessary  conditions  for  global 
asymptotic  stability  are  derived  in  terms  of  the  sampling  period.  These  conditions  demon¬ 
strate  that,  in  almost  all  cases,  fixed-point  arithmetic  does  not  allow  for  global  asymptotic 
stability  in  6-operator  formulated  discrete-time  systems  that  use  a  short  sampling  time. 
This  is  true  for  the  1-D  as  well  as  the  m-D  case. 
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L  INTRODUCTION 


Discrete-time  systems  formulated  in  terms  of  the  incremental  difference  operator  (or,  6- 
operator)  have  recently  been  receiving  considerable  attention  in  the  technical  literature  [1- 
4].  Most  of  this  work  focuses  on  the  superior  performance  of  the  ^-operator  under  fi¬ 
nite  wordlength  conditions  when  compared  with  the  shift-operator  (or,  g-operator).  In 
particular,  investigations  of  coefficient  sensitivity  and  quantization  noise  properties  have 
revealed  that  6-operator  formulations  usually  perform  significantly  better  than  their  g- 
operator  counterparts  [1-4].  This  is  especially  true  for  high-speed  applications  where  the 
sampling  rate  is  much  larger  than  the  underlying  system  bandwidth.  Under  these  condi¬ 
tions,  g-operator  formulated  discrete- time  systems  tend  to  become  ill-conditioned  [1-2]. 

Although  a  large  amount  of  work  is  available  on  the  effects  of  coefficient  sensitivity  and 
quantization  noise,  a  deterministic  study  of  the  nonlinear  behavior  of  discrete- time  sys¬ 
tems  formulated  with  the  6-operator  has  not  been  undertaken.  In  the  case  of  floating¬ 
point  (FLP)  arithmetic,  some  results  for  feedback  system  are  available  in  [2]. 

In  this  work,  we  focus  on  the  convergence  behavior  of  the  unforced  system  response  and 
global  asymptotic  stability  of  6-operator  formulated  discrete- time  systems  implemented  in 
fixed-point  (FXP)  arithmetic.  In  particular,  via  necessary  conditions  for  stability,  it  will 
be  shown  that  such  systems  tend  to  produce  DC  limit  cycles.  We  will  also  perform  a 
deterministic  analysis  of  the  finite  wordlength  properties  of  multi-dimensional  6-operator 
implemented  discrete  time  systems.  The  stability  behavior  in  the  m-D  case  has  not  been 
previously  investigated,  although  convergence  to  the  true  equilibrium  point (s)  is  one  of  the 
most  fundamental  requirements  for  any  discrete  time  system  realization. 

The  structure  of  this  article  is  as  follows:  In  Section  II,  we  introduce  notation  and  nomen¬ 
clature  for  the  1-D  case.  The  model  for  1-D  6-operator  formulated  discrete-time  systems, 
with  and  without  quantization  nonlinearities,  is  briefly  discussed.  Section  III  addresses 
the  problem  of  asymptotic  stability  for  the  1-D  case.  In  terms  of  ensuing  DC  limit  cy¬ 
cles,  necessary  conditions  for  global  asymptotic  stability  are  formulated.  It  is  shown  that, 
when  FXP  arithmetic  is  used,  stability  of  the  linear  system  is  often  lost.  Bounds  on  the 
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size  of  the  deadbands  are  also  provided.  In  section  IV,  the  mrdtidimensional  case  is  investi¬ 
gated  using  sets  of  1-D  conditions  for  asymptotic  stability.  Section  V  provides  concluding 

remarks. 


n.  NOTATION  AND  NOMENCLATURE 

Since  our  focus  is  the  investigation  of  stability  properties  of  5-operator  formulated  discrete¬ 
time  systems  under  unforced  conditions,  the  state  equations  of  the  system  under  zero-input 
will  be  considered. 

In  the  linear  case,  the  general  m-th  order  state-space  representation  is  given  by 

5[x](n)  =  A^x(n);  (1) 

x(n  -1- 1)  =  x(n)  -1-  A  •  6[x](n),  (2) 


where  x(n)  =  [»:i(n),...,x,n(n)]^  is  the  state  vector  at  instant  n,  =  {af.}  G  is  the 

system  matrix,  and  A  >  O  is  the  sampling  time.  Moreover,  6[  ]  represents  the  5-operator, 

that  is. 


5[xv](n) 


»i/(n  +  1)  —  X|/(n) 
A 


Vt/  =  1, . . . , 


(3) 


and  5[x](n)  =  [5[xi](n), . ..  ,<5[x„i](n)]^.  A  5  -system  is  stable,  if  and  only  if  the  following 
condition  on  the  eigenvalues  of  the  matrix  is  satisfied  [1]: 

lAf-A-M<A"^  i  =  l, •••,”»• 


Therefore  a  stable  system  matrix  cannot  be  defective,  i.e.  it  cannot  have  a  zero  eigenvalue. 


The  actual  implementation  of  (1)  and  (2)  in  FXP  format  gives  rise  to  nonlinear  quan¬ 
tization  operations  that  occur  at  various  locations  depending  on  the  hardware  realization. 

Eqn.  (1)  can  be  implemented  either  by  using  single  wordlength  accumulators  (creating 
a  quantization  error  after  each  multiplication)  or  by  using  double  wordlength  accumula¬ 
tors  (creating  a  quantization  error  only  after  summation).  We  will  only  consider  the  latter 
option  since  practically  all  modern  DSP  machines  offer  double  precision  accumulators. 
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Eqn.  (1)  can  then  be  written  as 


5[x](n)  =  (?{A«x(n)},  (4) 

where  Q  is  a  vector- valued  quantization  nonlinearity  of  the  form 

Q{x}  =  :  .  (5) 

\qmJ 

Here,  Q{xi,}  can  denote  magnitude  truncation,  two’s  complement  truncation,  or  rounding. 
Eqn.  (2)  can  be  implemented  in  two  different  ways: 

x(n  -I-  1)  =  x(n)  +  (5{A  ■  5[x](n)},  (6) 

or 

x(n  -t- 1)  =  <5{x(n)  +  A  •  5[x](n)}.  (7) 

Eqn.  (6)  corresponds  to  quantization  after  multiplication  while  (7)  corresponds  to  quan¬ 
tization  after  summation.  In  contrast  to  (1),  for  equation  (2),  it  is  not  clear  which  of 
the  two  quantization  schemes  in  (6)  and  (7)  is  preferable.  We  will  therefore  consider  both 
possibilities. 

Throughout  this  paper,  we  will  use  the  following  definition  of  stability: 

Definition.  The  discrete-time  system  in  (4,6)  or  (4,7)  is  globally  asymptotically  stable  if  and 
only  if,  for  any  initial  condition  x(0),  the  state  vector  x  asymptotically  reaches  zero,  that 
is,  x(n)  — »•  0  for  n  — >  oo. 

Comment.  Since  the  FXP  systems  considered  are  in  fact  finite  state  machines,  the  condi¬ 
tion  x(n)  — >  0  for  n  ^  oo  may  be  strengthened  to  ■x.{N)  =  0  for  some  finite  N  [5]. 

The  following  additional  symbols  will  be  used: 

/:  quantization  step  size 

0,1:  Vector  with  all  elements  being  zero  or  one,  respectively. 
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Int(x):  the  largest  integer  function,  i.e.  the  largest  integer  smaller  than  or  equal  to  x. 

'jyMT  'jyR  'jjTwo.  Deadbaiids  in  terms  of  the  incremental  difference  vector  for  magnitude 
truncation,  rounding  and  two’s  complement,  respectively. 

T>^'^  ,V^  :  Deadbands  in  terms  of  the  state  vector  x  for  magnitude  truncation, 

rounding  and  two’s  complement  truncation,  respectively. 

corresponding  deadband  for  the  unquantized  difference  vector, 
largest  hypercube  embedded  in  X>^^. 
smallest  hypercube  embedding  2?^'^. 


III.  NECESSARY  CONDITIONS  FOR  GLOBAL  ASYMPTOTIC  STABILITY 
III.l  DC  Limit  Cycles 

First,  we  will  consider  the  system  described  by  (4,6).  From  the  definition  for  global  asymp¬ 
totic  stability  as  stated  in  the  previous  section,  it  is  necessary  that 

Q{A  •  6[x](n)}  ^  0,  for  any  x(n)  ^  0.  (8) 

This  is  just  one  of  a  finite  set  of  conditions  that  is  required  to  ensure  global  asymptotic 
stability  of  a  FXP  implementation  of  a  linearly  stable  system  [5]. 

The  following  theorem  on  global  asymptotic  stability  of  delta-operator  formulated  discrete 
time  systems  provides  conditions  on  the  sampling  time: 


Theorem  1.  A  necessary  condition  for  global  asymptotic  stability  of  the  6-operator  formu¬ 
lated  discrete-time  system  in  (4,6)  is  A  >  0.5  for  rounding  and  A  >  1  for  truncation. 

Proof:  At  first,  we  will  address  the  case  of  magnitude  rounding:  The  necessary  condition 
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for  global  asymptotic  stability  (8)  is  violated,  if 


A  •  «[a:^](n)  1<  - 


for  = 


,m. 


(9) 


and  5[x](n)  9^  0.  With 


^[x,/](n)  =  /  for 


(10) 


we  can  rewrite  (9)  as 

A<i.  (11) 

2 

K  the  saxnphng  time  is  chosen  according  to  (11),  then  condition  (9)  is  satisfied  and  hence, 
the  system  will  exhibit  a  period  one  limit  cycle.  Therefore,  in  order  to  avoid  a  period  one 
limit  cycle  we  require 

A  >  i  (12) 

2 

(Additional  constraints  will  have  to  be  imposed  on  A  in  order  to  guarantee  the  absence  of 
limit  cycles  with  a  period  other  than  one.)  This  proves  the  Theorem  for  rounding. 


In  the  case  of  magnitude  truncation,  equation(9)  becomes: 


I  A  •  6[x„](n)  |<  /  for  (13) 

with  6[x](n)  0  With  (13)  and  (10),  one  arrives  at  the  following  condition,  which  excludes 

period  one  hmit  cycles: 

A  >  1  (14) 

For  two’s  complement  truncation,  equation  (9)  takes  the  form: 


0  <  A  ‘  ^[a7z/](n)  <  I 


(15) 


Together  with  (10),  the  above  equation  also  results  in  (14),  which  proves  the  Theorem. 


The  above  theorem  shows  that  high-speed  <5-operator  formulated  implementations  that 
possess  a  small  sampling  time  cannot  be  realized  limit  cycle  free  in  FXP  format!  Since  the 
advantages  of  delta-operator  systems  with  respect  to  coefficient  sensitivity  and  quantization 
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noise  require  a  short  sampling  time  much  smaller  than  one,  this  requirement  cannot  be 
met  if  Hmit  cycles  have  to  be  avoided. 

A  second  necessary  condition  for  the  system  in  {(4),  (6)}  can  be  obtained  by  noting  that 

5[x](n)  =  0  (16) 

can  occur  in  (4)  even  though  the  state  vector  x(r»)  ^  0. 

Therefore,  for  magnitude  rounding,  no  nonzero  state  vector  x(n)  that  belongs  to  the  quan¬ 
tization  lattice  and  satisfies 


(i\ 

(i\ 

<  A*  •  x(n)  <  -1- 

• 

UJ 

U/ 

may  be  allowed  to  exist.  In  (17),  the  inequality  has  to  hold  elementwise. 

Equation  (17)  has  the  following  geometric  interpretation: 

Each  of  the  resulting  m  inequalities  can  be  geometrically  interpreted  in  the  state  space  as 
the  intersection  of  two  half  spaces  in  3?™.  These  intersections  are  symmetric  about  the 
origin  and  have  parallel  boundaries.  The  normal  vector  to  the  boundaries  is  given  by  the 
particular  row  vector  of  .  Only  if  the  intersection  of  all  such  m  half  spaces  contains  at 
least  one  nonzero  point  in  Ji”*  on  the  quantization  lattice,  will  there  exist  a  nonzero  state 
vector  that  is  an  equilibrium  point  of  the  system  due  to  equation  (16).  Since  we  only 
consider  matrices,  which  are  stable,  the  system  matrix  A^  is  always  invertible.  One 
can  therefore  rewrite  (1)  to  obtain  a  sufficient  condition  for  the  existence  of  non-zero  state 
vectors,  which  are  equihbrium  points  due  to  equation  (16): 

x(n)  =  (A*)“^6[x](n)  with  6[x](n)  €  {—1/2, 1/2)”^  (18) 

In  order  to  obtain  bounds  for  each  of  the  components  of  x(n)  we  use  the  infinity  norm: 

II  x(n)  ||oo<||  (A')-i  llooll  6[x]{n)  |loo<||  (A*)"'  ||oo  ^  (19) 
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The  perallelepiped  described  by  (18)  is  therefore  imbedded  in  the  hypercuboid  described 
by  (19).  If  (19)  does  not  permit  any  points  x(n)  of  the  sampling  lattice,  instability  due  to 
(16)  cannot  occur.  From  (19),  this  is  the  ceise  if 

II  ||oo<  2.  (20) 

Eqn.  (16)  can  also  be  interpreted  from  an  eigenvalue/eigenvector  viewpoint.  In  high-speed 
digital  filters  where  the  sampling  frequency  is  typically  much  higher  than  the  bandwidth 
of  the  processed  signal,  the  eigenvalues  of  a  g-operator  implementation  cluster  around  the 
point  z  =  1  [1].  The  corresponding  5-operator  implementation  for  large  sampling  times  has 
eigenvalues  clustered  around  zero.  However,  as  the  sampling  time  becomes  small,  these 
eigenvalues  move  towards  the  eigenvalues  of  the  underlying  continuous-time  system  [1].  In 
other  words,  for  large  sampling  times,  the  system  matrix  will  be  ill-conditioned,  that  is, 
vectors  x(n)  ^  0  exist  such  that  A*  •  x(n)  is  close  to  the  zero  vector.  According  to  (16), 
this  is  likely  to  cause  a  DC  limit  cycle.  For  small  sampling  times,  this  problem  may  not 
occur;  however,  in  this  case,  the  conditions  in  Theorem  1  are  not  satisfied  and  the  system 
is  already  known  to  produce  limit  cycles. 


In  the  case  of  the  remaining  two  quantization  schemes,  the  inequalities  corresponding 
to  (17)  are  given  below:  For  two’s  complement  truncation. 


0  <  A*  •  x(n)  < 


,  x(n)  5^  0, 


(21) 


and,  for  magnitude  truncation. 


<  A*  •  x(n)  <  -t-  I  • 


x(n)  5^  0. 


(22) 


Again,  the  above  inequalities  have  to  interpreted  elementwise.  The  embedding  hypercubes 
can  be  constructed  for  the  perallelepiped  in  (21)  and  (22)  in  a  similar  fashion  as  for 
rounding  in  (18). 


So  far,  we  only  addressed  the  system  described  by  (4,6).  A  similar  analysis  can  be 
conducted  for  the  system  in  (4,7).  Since  (4)  is  common  to  both  realizations,  equations 
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(17,21,22)  axe  still  valid  and  provide  conditions  under  which  the  finite  difference  is  quan¬ 
tized  to  zero  and  a  DC  limit  cycle  is  produced.  We  will  now  briefly  discuss  necessary 
conditions  for  global  asymptotic  stability  obtained  from  (7). 

A  period  one  limit  cycle  exists,  if  the  condition 

X  =  Q{x  +  A5[x](n))  (23) 


is  satisfied  for  x  0.  Using  a  similar  argument  as  in  the  proof  of  Theorem  1,  for  rounding, 
equation  (23)  is  satisfied  if: 


<  A(5[a:„](n)  <  ^ 

for 

H 

V 

o 

(24) 

-^  <  A6[x,,](n)  <  ^ 

for 

o 

V 

A 

(25) 

-^  <  A<5[a;,,](n)  <  ^ 

for 

Ity  =  0 

(26) 

1/ =  !,■■■, 

m 

Therefore 

(27) 

is  required  to  exclude  period  one  limit  cycles. 
For  magnitude  truncation,  (23)  is  satisfied,  if 


0  <  A(5[x,/](n)  <  / 

o 

A 

o 

(28) 

— /  <  A6[a;i/](n)  <  0 

for  Xu  <  0 

(29) 

— /  <  A6[a;i/](n)  <  / 

for  Xu  —  0 

(30) 

=  1,** 

In  the  case  of  two’s  complement  truncation,  the  condition  for  a  DC  limit  cycle  is  simply 
given  by 


0  <  A5[a:v](n)  <  /,  i/  =  1,  •  •  • ,  m. 


(31) 
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The  conditions  (28-30)  and  (31)  again  result  in  the  condition  A  >  1  for  the  absence  of 
period  one  limit  cycles. 

We  therefore  obtain  almost  the  same  conclusion  as  for  the  previously  considered  system: 

A>-  for  magnitude  rounding; 

2 

A  >  1  for  truncation. 

Therefore,  Theorem  1  also  holds  for  the  system  representation  in  {(4),  (7)},  if  the  condition 
for  rounding  is  slightly  changed  to  A  >  | . 


Upto  now,  we  provided  necessary  conditions  for  stability  of  delta-operator  fomulated 
discrete  time  systems  in  fixed  point  arithmetic.  Since  it  heis  been  established,  that  for 
small  sampling  periods,  the  delta-operator  systems  always  exhibits  period  one  limit  cycles, 
one  needs  to  examine  the  amplitude  of  these  limit  cycles  for  a  given  sampling  time  in  order 
to  obtain  further  insight  into  the  practical  impact  of  this  problem.  In  what  follows,  bounds 
on  the  deadbands  will  be  derived  as  a  function  of  the  A^-matrix  and  the  sampling  time  A. 

HI. 2  Deadband  Bounds 

This  subsection  provides  an  answer  to  the  question  of  the  size  of  the  limit  cycle 
amplitudes.  Given  a  sampling  time  A  and  a  system  matrix  A*,  bounds  for  the  deadbands 
as  well  ELS  the  deadband  geometry  will  be  described.  This  will  be  done  in  detail  for  the 
case  of  magnitude  truncation.  For  magnitude  rounding  and  two’s  complement  truncation, 
the  results  will  be  stated  briefly  without  proof.  Since  the  results  for  the  system  (4,7)  are 
very  similar  to  the  results  for  the  system(4,6),  this  subsection  focuses  only  on  the  latter. 

For  each  quantization  scheme,  we  will  provide  the  geometry  of  the  deadband  in  terms 
of  the  incremental  difference  vector  as  well  as  the  state  vector.  Two  hypercubes,  which 
bound  the  deadband  region  from  the  inside  and  the  outside  axe  also  derived  for  each  case. 

Theorem  2: 


For  the  system  (4,6)  implemented  in  magnitude  truncation. 


the  deadband  (in  terms  of 
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period  one  limit  cycles)  in  the  incremental  difference  vector  space  is  given  by: 


=  MM  IIoo<MA-^ )-!]•/}  for  /n<(A-i)  =  A-^  (32) 

and 

l?f'^  =  {6[x]|  M[x]||oo</nf(A-i)0  for  Jn<(A-l)^A-^  (33) 

The  corresponding  period  one  limit  cycle  deadband  in  the  state  space  is  given  by 

=  {x  I  X  =  (A^)-^5[x],  «[x]  6  Af^}  (34) 

where 

w4^^  =  {6[x]|  II  6M||oo<[/n<(A"^  )  +  !]•/}  for  /n<(A“^)  5-4  A"^  (35) 

and 

•4f  ^  =  {^M  I  II  ^M  lloo<  Int(A-^)  •  /}  for  Int(A-^)  =  A-^  (36) 

Proof: 

The  proof  will  be  carried  out  for  Int(A~^)  A“^,  since  the  case  Int(A~''-)  =  A~^  follows  in  a 
similar  fashion.  From  (13),  the  expression  for  period  one  limit  cycles  can  be  expressed  as 

II  A^[x](n)  |U<  /.  (37) 

Solving  (37)  for  6[x]  and  considering,  that  5[x]  produced  by  equation  (4)  is  an  integer 
multiple  of  the  quantization  step  /,  one  obtains 

MM(«)lloo</n<(A-i)-/  (38) 

for  Int(A~^)  A~^  which  is  the  hypercube  in  (33).  Now  consider  the  following  slightly 
larger  hypercube  in  ^[x]: 

«4f^  =  WI  MM  lloo<[/n<(A-l )  +  !]/}  (39) 

, describes  the  open  set  of  all  incremental  difference  vectors,  which,  after  quantization 

will  be  mapped  into  the  hypercube  ,  i.e. 

Q(6[x])  €  Uf  V^[x]  €  A^'^. 
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Therefore  the  deadband  in  terms  of  x  can  simply  be  found  by  determining  the  set  of  all  x, 
which  satisfy 


Since  was  assumed  to  be  linearly  stable,  it  is  also  invertible  .  Therefore  the  deadband 
in  the  state  space  is  obtained  by 

i>;J"^  =  {x|x  =  (aV6[x],  6[x]e>if^} 

This  completes  the  proof  for  /n<(A“^)  ^ 


The  following  Corollary  provides  the  largest  hypercube  in  the  state  space,  which  is  con¬ 
tained  in  the  perallelepiped  .  This  result  allows  to  obtain  the  largest  magnitude  of 
state  vector  components,  which  can  still  belong  to  the  deadband.  It  also  provides  a  simple 
upper  bound  on  the  volume  of  the  deadband. 


Corollary  3: 

The  largest  hypercube  ^  embedded  in  is  given  by: 

«r=(xi  iixwii„<M^^^} 

II  ^  l|oo 

and  by 

II  ^  ||oo 

Proof: 

Assume  lnt{A  A“^.  From  (1)  we  obtain  for  the  unquantized  incremental  difference 
vector: 

lUM  ||oo<||  lloollxlloo  (42) 

Since  Af  ^  describes  the  set  of  unquantized  difference  vectors,  which  after  quantization 
maps  into  the  deadband  region  one  can  use  the  right  side  of  (42)  to  ensure,  that 

equation  (39)  is  satisfied  and  obtain: 

II  A^  llcoll  x||oo<  [/n<(A~^)-t- 1] ./  (43) 


for  Int(A  ^  A  ^ 


(40) 


for  Int(A~^)  =  A~^ 


(41) 
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Solving  (43)  for  1|  x  l|oo  produces  the  desired  result.  Since  ^  is  a  hypercube  centered  at 
the  origin,  there  exists  a  x  €  such  that 

II  6[x\  ||oo=ll  llco  •  II  X  Hoc  .  (44) 

Hence  this  is  the  largest  such  hypercube.  The  proof  for  the  case  Int{A~^)  =  follows 
from  (43)  in  a  similar  fashion. 


The  next  Corollary  provides  the  smallest  hypercube  in  the  state  space,  which  still 
contains  .  This  provides  a  lower  bound  on  the  volume  of  the  deadband: 

Corollary 


The  smallest  hypercube  containing  is  given  by 

Wu^  =  {x|  II  X  1|oo<|1(A*)~M1oo  (/nt(A-^) +  !)•/}  /or  /n<(A-^)  A"^  (45) 

and 

Wtf’’  =  {x|  ||x||co<||(A^)-Mloo/n<(A-^)-/}  /or  /n<(A-^)  =  A"^  (46) 

Proof: 

At  first  consider  the  case  Int{A^^)  ^  A"^:  From  (1)  we  have  for  the  unquantized  state 
vector: 

x=(yl*)-^6[x]  (47) 

Talcing  norms  and  using  the  inequality  in  (35),  we  obtain  the  following  open  hypercube, 
which  contains  V^'^: 

II  X  11=0 <11  (A^)-i  llcoll  6[k]  ||oo<||  (A«)-i  llco  [7n<(A-i)  +  1]  •  / 

Since  is  a  hypercube  centered  at  the  origin,  there  exists  a  6[x],  such  that 

II  (•4*)  ^  llooll  ^[x]  11=0  =  11  X  ||oo  • 

Hence  is  the  smallest  such  hypercube.  The  proof  for  the  case  Jnf(A-^)  =  A"^  is 
identical  and  requires  the  use  of  (36)  instead  of  (35). 
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Remarks: 


1.  Since  ||  I1  •  ||  (A^)  ||>  1,  we  have  C  For  matrices  which  satisfy 

ii(A^rMu-iiA^iioo=i  m 

the  two  hypercubes  axe  identical  and  coincide  with  the  deadband  region  ^  i.e. 

2.  Vf'^  is  a  closed  m-D  hypercube,  centered  around  the  origin.  Its  boundary  coincides 
with  points  of  the  quantization  lattice.  The  faces  of  the  hypercube  are  orthogonal  to 
the  corresponding  axis  of  the  incremental  difference  vector  space. 

3.  is  an  open  parallelepiped.  describes  the  deadband  for  period  one  limit 

cycles  in  terms  of  the  state  vector. 

4.  The  total  deadband  includes  the  region  (  V^'^)  for  the  incremental  difference 

vector  (the  state  vector.) 

5.  A  useful  measure  of  the  deadband  size  in  terms  of  the  state  vector  x  is  the  volume  in 
the  state  space.  The  Volume’  Vols  of  the  deadband  in  6[x]  is  easily  computable  due  to 
the  hypercube  geometry.  From  (47)  we  obtain  for  the  volume  Volx  in  the  state  space 
of  x: 

Volx  =^det{{A^)-^)  •Vols  (49) 


6.  Given  a  realization,  increasing  the  sampling  rate  (A  ^ )  will  result  in  a  larger  deadband. 

The  relationships  for  the  deadband  of  quantization  schemes  other  than  magnitude  trunca¬ 
tion  are  given  below: 

Magnitude  Rounding: 


=  II  5[x]lloc<[/nt(iA-') -!]•/}  for  (50) 
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and 


=  IKMI!oo</n<(iA-i)-Z}  for 


(51) 


For  the  deadband  in  terms  of  the  state  vector  we  have: 


=  {x  1  X  =  (A*)  ^6[x],  6[x]  €  Af }  (52) 

where 

Af  =  {^[x]  1  II  «[x]  ||oo<  [/nZ(iA-i)  -  i]  •  /} 

and 

Af  =  {5[x]  I  II  6[x]  ||oo<  [/n<(i  A-^)  +  ^]  •  0 
Two^s  Complement  Truncation: 

=  {6[x]  I  0  <  5[x]  <  1  •  [7n<(A-^)  -  1]  •  /} 

and 

=  {6[x]  1  0  <  5[x]  <  i  •  IntiA-^ )  ■  /} 

For  the  deadband  in  terms  of  the  state  vector  we  have: 

Dj'^°  =  {x|x=(A«)-^6[x].  6[x]€AJ^^}  (57) 

where 

^TWO  _  I  0  <  6[x]  <  1  •  7n<(A-^)  •  /}  for  Int(A-^)  =  A"^  (58) 

and 

^TWO  _  I  0  <  5[x]  <  1  •  [7nt( A-i  )  +  !]■/}  for  Int(A-^ )  ?^  A-^  (59) 

In  the  above  set  definitions,  all  inequalities  axe  to  be  interpreted  elementwise,  i.e.  x  <  y 
with  x,y  G  means  xj  <  y,-,  i  =  Furthermore,  the  notation  0,1  stands  for  the 

zero  vector  and  the  vector  with  component  values  of  one,  respectively. 


for  Int{A  ^)  =  A  ^  (55) 

for  7n<(A-^)#A-^  (56) 


for  7n<(  — A  ^)  =  — A~^  (53) 

for  Int(^A~^)  ^ (54) 
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IV.  THE  M-D  CASE 


rV.l  Additional  Notation  for  the  m-D  Case 

The  m-D  Roesser  model  has  the  following  ^-operator  formulation  [7]: 

«(»|x(»)(n)  1  rA‘j  •••  rx<‘)(ii)i  r  - 

:  =  :  ■•  :  ■  -1-  •  u(n);  (60) 

<<’”)(x(’")](n)J  [aI,  -  AlJ  Lx(’">(n)J  Lb^. 

1  r  x^^^(n)  i  r  ' 

:  =  ;  +A-  :  .  (61) 

,(»>)(x(”>)l(n)J  Lx'^’Cn)]  Li<”>[x(”*>](ll). 

The  input-state  equations  in  (60)  and  (61)  describe  a  first  hyper-quadrant  causal  m-D 
system  with  a. uniform  sampling  period  of  A  in  all  directions.  The  operators  5^*^  and  6^*^ 
represent  the  shift-  and  delta-operator  in  the  direction  specified  by  the  a^is  rij.  In  particular 

^(«)[x(»)](n)  =  , . . . ,  n,_i ,  nj  -t- 1,  rii+i rim)  (62) 

^(»)[x(*)](n)  =  ■l(x^’^(ni, ...  -|-  1,  nj+i, . . .  ,nr„)  -  x^‘)(n)).  (63) 

Here,  (n)  =  (ni , . . . ,  rim)  denotes  a  point  in  the  first  hyper-quandrant,  x^*^(n)  is  the  portion 
of  the  state  vector  propagating  in  the  direction  specified  by  the  axis  n^,  u(n)  is  the  m-D 
input  vector,  and  Afj  and  Bf,  for  i  =  1, . . . ,  m,  j  =  1, . . . ,  m,  are  the  submatrices  of  the 
system  and  input  matrices,  respectively. 

If  (60)  is  realized  in  fixed-point  arithmetic,  it  takes  the  following  form  under  zero- input 
conditions: 

«<‘)[x<')l(n)  1  ^  r  A*,  ■  ■  •  1  r  x('>{n)  I  \ 

'■  =Q(  :  :  i  (64) 

j(..)[x(m)i(„)J  ...  a5.„J  Lx<>»)(n)J  J 

Equation  (64)  assumes  quantization  after  summation;  since  practically  all  mod¬ 
ern  DSP  machines  implement  this  quantization  scheme,  we  only  consider  this  format.  The 
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vector- valued  quantization  nonlinearity  Q{-}  may  represent  any  one  of  the  conventional 
schemes,  viz.,  magnitude  truncation,  magnitude  roimding,  two’s  complement  truncation, 
and  two’s  complement  rounding. 


Equation  (61)  can  be  implemented  in  two  different  forms: 


■  g^^^[x^*^](n)  ■ 

■  x(i)(n)  ■ 

f 

5l')(x(»](n)  1 

_^(m)[x(m)j(n) 

= 

_x(”*)(n). 

+  Q  ^ 

A- 

1 

? 

t 

> 

(65) 


or 


r 

-  x(i)(n)  - 

-  ^(i)[x(i)](n)  - 

> 

• 

=  Q< 

+  A- 

• 

_g(»”)[x(”*)](n). 

.x(’")(n). 

J 

(66) 


Equation  (65)  corresponds  to  quantization  after  multiplication,  whereas  (66)  corresponds 
to  quantization  after  addition.  In  contrast  to  (60),  for  (61),  it  is  not  obvious  which  of  the 
two  forms  stated  above  is  preferable. 


The  following  definition  for  asymptotic  stability  [8]  will  be  used  throughout  this  paper. 


Definition.  An  m-D  first  hyper- quadrant  causal  discrete-time  system  is  asymptotically 
stable  under  all  finitely  extended  bounded  input  signals  u(n)  where 

|u(n)|  <5,  for  ni  H - hrim  <  D-,  (67) 

u(n)  =  0,  for  ni  -| - 1-  rim  >  D,  (68) 

if  all  the  states  of  the  m-D  discrete-time  system  asymptotically  reach  zero  for  nj  -f-  •  •  •  -f 
rim  oo-  Here,  n,/  >  0,  i/  =  1, . . . ,  m,  5  is  a  nonnegative  real  number,  and  £)  is  a  positive 
integer. 


Since  the  fixed-point  systems  considered  are  in  fact  finite  state  machines,  the  condition 

/x(^)(n)x 

•  ^0, 

\x<’")(n)/ 
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for  rzi  H - 1-  rim  —>■00,  >  0,  u  =  1,. . .  ,m,  can  be  strengthened  to 

x(i)(n) 

for  all  points  ni  H - H  rim  >  c?  >^1/  >  0,  u  =  where  c  is  some  finite  integer. 

rV.2  Necessary  Conditions  for  Global  Asymptotic  Stability 

In  this  section,  we  present  some  necessary  conditions  for  stability  of  a  first  hyper¬ 
quadrant  causal  m-D  discrete-time  system  represented  in  its  Roesser  local  state-space 
model  in  (60,61).  These  necessary  conditions  are  formulated  in  terms  of  1-D  conditions. 
This  theorem  follows  directly  from  a  result  in  [6]  which  was  formulated  for  g-operator 
implemented  discrete-time  systems.  The  proof  of  the  theorem  rests  on  the  fact  that  a  first 
hyper-quadrant  m-D  system  can  be  described  by  a  1-D  system  for  those  locations  that  are 
along  the  m  coordinate  axes  of  the  boundary  of  the  hyper-quadrant.  Reformulating  the 
result  in  [6]  for  ^-operator  systems  produces  the  following  theorem: 

Theorem  5. 

(a)  A  necessary  condition  for  global  asymptotic  stability  of  the  system  in  (64,65)  is 
that  each  of  the  following  1-D  systems  in  (69,70)  is  globally  asymptotically  stable: 

=  (69) 

+  Q  I A  •  ^  (70) 

where  i  =  1, . . .  ,m. 

(b)  A  necessary  condition  for  global  asymptotic  stability  of  the  system  in  (64,66)  is 
that  each  of  the  following  in  1-D  systems  in  (71,72)  is  globally  asymptotically  stable: 

«(6[x<6j(„i)  =  Q{[4jx«(„0};  (71) 

5<6|x<6|(ni)  =  Q  {x<'>(ni)  +  A  ■  i(6(x‘')|(„,)}  ,  (72) 


where  i  =  1, . . .  ,m. 
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Proof.  For  a  detailed  proof,  and  generalizations  to  higher  sub-dimensional  systems,  the 
reader  is  referred  to  [6]. 

Theorem  5  can  be  viewed  as  an  extension  of  the  concept  of  practical  BIBO  stability 
to  asymptotic  stability  of  nonlinear  systems.  It  is  particularly  useful  in  proving  instability 
in  m-D  nonlinear  systems. 

We  can  now  combine  Theorem  1  and  Theorem  5  to  formulate  a  necessary  condition 
for  stability  of  m-D  first  hyper-quadrant  causal  ^-operator  formiilations  of  the  generalized 
Roesser  model. 

Corollary  6. 

(a)  A  necessary  condition  for  global  asymptotic  stability  of  the  m-D  systems  in  (64,65)  is 

A  >  0.5,  for  magnitude  rounding; 

A  >  1,  for  truncation. 

(b)  A  necessary  condition  for  global  asymptotic  stability  of  the  m— D  system  in  (64,66)  is 

A  >  0.5,  for  magnitude  rounding; 

A  >  1,  for  truncation. 

Proof.  The  proof  follows  from  Theorems  1  and  5. 

Remarks: 

1.  Corollary  6  is  also  essentially  applicable  to  the  case  where  the  sampling  time  varies 
with  the  direction  of  propagation.  In  the  case  of  the  system  description  (64,65),  the 
inequalities  in  Corollary  6  would  have  to  be  replaced  by 

Aj  >  0.5,  for  magnitude  rounding; 

Ai>l,  for  truncating, 

for  i  =  1, . . . ,  m.  The  conditions  for  the  system  (64,66)  are  analogous. 
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2.  Otir  analysis  is  limited  to  the  zero-input  case  for  which  DC  limit  cycles  along  the  axis 
were  used  to  derive  conditions  for  non-convergence.  If  one  includes  other  types  of  limit 
cycles  in  the  analysis  or  even  response  types,  which  are  not  periodic  and  axe  known 
to  exist  only  in  the  m-D  case,  the  requirements  for  A  may  become  even  more  severe. 

3.  Corollary  6  shows  that  fixed-point  implementations  of  1-D  and  m-D  ^-operator  sys¬ 
tems  cannot  he  realized  limit  cycle  free,  if  good  coefficient  sensitivity  and  quantization 
noise  measures  have  to  be  achieved. 

V.  CONCLUSION 

In  this  paper,  it  was  shown  that  fixed-point  implementations  of  1-D  and  m-D  6- 
operator  systems  are  not  limit  cycle  free  even  if  the  underlying  linear  system  is  stable  and 
the  sampling  time  is  chosen  small.  This  non-convergent  behavior  can  be  explained  by  the 
quantization  of  the  ^-term  to  zero  which  leaves  the  state  vector  unchanged.  The  smaller 
the  sampling  time,  the  more  severe  this  effect.  The  size  of  the  deadband  increases  with 
a  decreasing  sampling  time.  Therefore,  the  practical  value  of  ^-operators  for  fixed-point 
implementations  of  1-D  and  m-D  systems  is  questionable.  There  are  however  indications 
that  this  effect  is  much  less  severe  in  floating-point  implementations. 

6-operator  implemented  discrete-time  systems  represent  a  class  of  systems  where  the 
quantization  noise  at  the  output  can  be  small  compared  to  other  realizations.  However, 
as  was  shown  above,  such  realizations  will  invariably  exhibit  limit  cycles,  which  are  highly 
correlated  quantization  noise.  Therefore,  in  this  case,  typical  measures  for  quantization 
noise  are  of  very  limited  use  for  obtaining  any  insight  into  the  likelihood  of  limit  cycles 
and  vice  versa. 
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Abstract: 

Zero  input  asymptotic  response  behavior  of  general  order  2-D  digital  filters  with  floating 
point  arithmetic  is  investigated.  In  particular,  conditions  for  the  absence  of  so-called  R1 
and  R2  responses  (large  amplitude  limit  cycles)  are  provided  for  2-D  first  quarter-plane 
causal  filters. 
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I,  Introduction 


Recently,  floating  point  arithmetic  has  become  popular  for  a  number  of  digital  signal 
processing  applications.  The  implementation  of  digital  Alters  in  floating  point  format  is 
especially  attractive  due  to  the  high  dynamical  range  and  the  high-level  programming  tools 
available. 

Previous  work  on  the  convergence  behavior  of  floating  point  digital  Alters  concentrated 
on  1-D  second  order  system  [1].  Some  results  on  direct  form  filters  are  also  available  [2]. 
However,  to  the  authors’  knowledge,  the  case  of  general  order  1-D  or  2-D  state  space  models 
has  not  been  tackled. 

This  paper  provides  such  an  analysis  which  can  be  applied  to  any  digital  filter  structure 
of  arbitrary  order  and  dimension  one  or  two.  In  order  to  avoid  distinguishing  among  a  num¬ 
ber  of  reformatting  and  quantization  schemes,  the  result  introduced  in  this  paper  takes  a 
parameterization  approach  to  the  error  description.  This  allows  to  apply  the  derived  result 
to  any  type  of  floating  point  format. 

II.  Preliminaries 

Consider  the  Roesser  model  for  the  first  quarter-plane  causal  2-D  system: 

/  x^(ni  +  l,n2)  \  ^hh  ^hv  ^  \  qx 

\  i.’'(ni,n2 -h  1)  /  V  ^vh  -^vv  ]  \  ^{ni,n2)  J 


A 


f  Ahh 

\  A„h 


Ahv 


Ahh  e 


A  e  gj(^l+^2)x(Afl-^iV2) 


A  a  S(>N2y~N2 


(2) 


The  submatrices  A^h  and  Ahv  are  of  the  appropriate  dimensions.  The  vectors  and  ^ 
are  horizontally  and  vertically  propagating  state  vectors  of  the  ideal  system,  respectively. 

For  floating  point  realizations  of  (1),  the  following  error  model  describes  the  system 
behavior: 

(  x^{ni  +  l,n2)  \  ^(  Mh  Ahv  \  (  £'{ni,n2)  ^  /  e'‘(ni,n2)  \  (-3X 

V  «’'(ni,n2  +  1)  )  V  Aw  J  [  x^(ni,n2)  J  [  e^(ni,n2)  J 

where  e'‘(ni,n2)  6  e’'(ni,n2)  6  are  the  error  vectors  for  the  horizontally  and 

vertically  propagating  states,  respectively. 
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We  also  need  to  define  the  following  transfer  matrices: 

(  _  f  H’'’'{z„Z2)  H'"’(ZuZ2)  ]  (  g‘(zi,Z2)  \ 

\H"'‘Iz2,Zz)  H'’"(zi,Z2)  j  £”(2l,  2:2)  J 


where 


(  H^^{zi,Z2)  H^^{zi,Z2) 

[H^^iz^,Z2)  H^''{zi,Z2) 


zJi  (t> 
<j)  Z2h 


(5) 


In  Equation  (4),  X!^{zi,Z2)  and  X"(zi,^r2)  are  the  ^-transforms  of  the  states  ^^(ni,n2)  and 
x^(ni,  ^2),  respectively.  The  transforms  Z2)^H^'^{z\^  ^2)5  ^2)  and  H'^''{zi,Z2) 

are  transfer  submatrices  of  dimensions  A^i  x  N\,Ni  x  N21N2  x  Ni,N2  x  N2,  respectively. 
E^{z-^,Z2)  and  £"'(^1,^2)  are  the  2-D  z-transforms  of  the  error  signal  vectors  e^(ni,n2) 
and  e’'(ni,n2),  respectively.  Furthermore,  in  (5),  Ii  and  I2  denote  identity  matrices  of 
dimensions  Ni  x  A^i  and  N2  X  N2,  respectively. 


The  components  H>^’^{zi,  Z2),  H^^{zr,  Z2),  Z2)  and  ^""(^1,^2)  are  2-D  transforms 

denoted  by  -^2), ^2),  ^2)  and  respectively. 

Denoting  as  the  2-D  z-transform,  we  define  the  following  impulse  responses: 


H^l{zi,Z2)  =  2:{/if/(ni,n2)};  i 
H^^{zr,Z2)  =  Z{h'lJ{nun2)]\  i 
H^i'{z^,Z2)  =  S{/^J(nl,n2)}; 

H^i-{zr,Z2)  =  ^{/i-/(ni,n2)};  «  ^ 


=  1,- 

i  =  Ir 

(6) 

=  !,•• 

i  =  i,- 

■•,iV2. 

(7) 

••,iV2; 

i  =  i,- 

(8) 

•,iV2; 

■,N2. 

(9) 

Next,  we  define  the  /i -measures  for  each  component  of  the  transfer  function  submatrices: 


Also: 


00  00 


TJVV 

Hij 

ni=0  712—0 
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00  00 

ni=0  712=0 

(11) 
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(13) 
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(14) 

II 
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From  [1,2]  it  is  known  that  the  following  four  state  response  types  are  encountered  in  float¬ 
ing  point  digital  filters  under  zero  input,  if  the  linear  filter  is  stable. 

Rl:  an  unbounded  state  response,  eventually  leading  to  overflow  conditions. 

R2:  a  bounded  state  response 

R3;  a  bounded  state  response  in  underflow 

R4:  a  zero- convergent  response 

III.  The  Main  Result 

The  following  theorem  can  now  be  formulated: 

Theorem:  A  floating  point  implementation  of  the  system  in  (1)  for  any  finitely  extended 
input  signal  and/or  non-zero  finitely  extended  initial  conditions  will  produce  a  response 
type  R3,  if  the  mantissa  length  Im  satisfies 

>  2  +  log2  H  +  log2  C  (16) 

where  H  =  maxij(^f ,  and  C  is  an  implementation  dependent  constant. 

Proof:  The  proof  is  rather  lengthy  and  will  be  supplied  in  the  final  version  of  the  paper. 

Formally,  this  result  is  similar  to  previous  results  on  direct  forms  [1]  and  second  order 
state-space  systems  [2].  In  this  case,  the  stability  margin  enters  the  inequality  through  H, 
which  is  a  somewhat  complicated  measure  of  the  degree  of  stability  of  the  system.  For  an 
unstable  system  H  — >  oo,  and  for  any  stable  system  we  have  H  <  oo.  The  constant  C 
relates  the  magnitude  of  the  state-variables  to  the  error  bound.  This  number  is  usually 
small  and  is  directly  affected  by  the  entries  of  the  A-matrix  and  the  floating  point  format. 

IV.  Conclusion 

This  paper  presents  a  condition  on  the  mantissa  length  of  a  2-D  floating  point  digital 
filter  of  arbitrary  order,  which  ensures  convergence  of  the  state-response  into  underflow, 
independent  of  the  initial  conditions.  The  mantissa  length  is  linked  to  the  margin  of  sta¬ 
bility  of  the  linear  system  as  measured  by  H.  It  is  also  dependent  on  the  realization  itself. 
It  should  be  noted  that  the  response  types  R2  and  R3  in  the  2-D  (and  m-D)  case  do  not 
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need  to  be  periodic  [3]. 
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Extended  Abstract 

This  extended  abstract  is  being  submitted  for  possible  presentation  at  the  lASTED  Inter- 
national  Cojiference  on  Modelling  and  Simulation,  Colombo,  Sri  Laaika,  July  26-28,  1995. 

Introduction 

Traditional  control  and  signal  processing  algorithms  based  on  shift-operator  (or,  q- 
operator)  ai-e  ill-conditioned  in  high  performance  applications  that  involve  fast  sam- 
pling/shorter  wordlength  [1].  In  these  situations,  g-operator  based  discrete-time  imple¬ 
mentations  (or,  ^-systems)  are  extremely  sensitive  to  imcertainties  inherent  in  modelling 
and  pai-anieter  representation  (in  particular,  with  shorter  wordlength). 

Use  of  incremental  difference  operator  or  delta-operator  (or,  ^-operator)  can  provide 
an  effective  solution  to  such  difficulties  [1].  Compaxed  to  g-systems,  ^-operator  based  im¬ 
plementations  (or,  ^-systems)  can  provide  superior  performance  with  respect  to  (a)  coeffi¬ 
cient  sensitivity  of  frequency  response  [l],  and  (b)  quantization  noise  propagation  [2].  Due 
mainly  to  these,  and  also  due  to  the  possibility  of  a  unified  treatment  of  both  continuous- 
and  discrece-time  .sj''stems,  work  on  5-systems  has  recently  attracted  considerable  attention 
(see  [1-5],  and  references  therein). 

Problem  Statement 

Since  5-operator  can  offer  several  important  advantages  over  g-operator  for  linear,  time- 
invariant  one- dimensional  (1-D)  systems,  would  similar  advantages  hold  true  for  more 
general  classes  of  systems?  Work  on  linear,  multi-dimensional  (m-D)  systems  indicate 
that  this  may  indeed  be  the  case  [5].  In  this  paper,  we  investigate  the  applicability  of 
5-operator  based  numerical  schemes  for  simulation  of  nonlinear  systems. 

Delta-0 PER.vroR  Based  Numerical  Scheme 

q-Operator  Based  Numerical  Scheme.  We  consider  the  computation  of  solution  orbit  of  a 
nonlinear  system  of  the  type 

g[x](n)  =  f,(x(n),a,),  (1) 

where  f/[x](n)  =  x(n  +  1).  Here,  x(n)  is  the  state  orbit  x  6  3?"*  at  instant  n  and 

Kaiiial  Preinaratne  and  Peter  H.  Bauer  gratefully  acknowledge  the  support  provided  by  the  Office  of 
Naval  Research  (ONR)  through  the  grants  N00014-94-1-0454  and  N00014-94-1-0387,  respectively. 
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a,  =  [ai,,. . .  €  3?^  refer  to  system  parcimeters  that  are  actually  stored  within 

the  computer  while  performing  the  iteration. 

S'Operator  Based  Numerical  Scheme.  The  proposed  ^-operator  based  scheme  of  the  same 
nonlinear  system  in  (1)  is 

^[x](n)  =  fi(x(n),  a^)  (Intermediate  equation) 

$[x](n)  =  x(n)  +  A  •  ^[x](n)  (Update  equation), 

where  ^[x](n)  =  (^[x](n)  — x(n))/A  and  f5(x(n),a5)  =  (fj(x(n),ag)  —  x(n))/A.  Here,  A  is 
an  arbitrary  positive  real  parameter  (usuatUy  the  grid  size)  and  a^  =  , . . . ,  05*^]^  G 

again  refer  to  system  parameters  that  aire  actually  stored  within  the  computer. 

Now,  which  of  the  schemes  (1)  or  (2)  yield  superior  coefficient  sensitivity  of  its  orbit 
with  respect  to  perturbation  of  a,  or  ,  respectively?  This  consideration  is  crucial  in  high 
performeince,  real-time  applications  that  may  require  fast  sampling/ shorter  wordlength.  Of 
course,  with  infinite  wordlength,  both  (1)  and  (2)  yield  identical  results.  In  our  develop¬ 
ment,  the  nonlineaiity  is  taken  to  belong  to  that  is,  it  possesses  first  partial  derivatives. 
Small  perturbations  are  assumed. 

Contributions 

The  contributions  of  this  paper  are  the  following: 

1.  Development  of  coefficient  sensitivity  measures  Mpxp  IkfpLP  for  fixed-point  (FXP) 
and  floating-point  (FLP),  repectively.  These  tahe  into  account  that  in  FXP,  coefficient 
perturbation  is  approximately  independent  of  its  nominal  value,  while  in  FLP,  it  is 
approximately  proportional. 

2.  FXP:  Mpxp  for  ^-system  is  A  times  Mpxp  for  5-system.  Hence,  ^-system  is  superior 
imder  small  grid  size. 

3.  FLP:  Mflp  for  5-system  is  superior  than  Mflp  for  5-system  if  —  ll  ^  |,  Vi  = 

1, . . . ,  M.  Here,  a,-^  indicates  the  ‘linear’  term  in  the  i-th  equation  of  fg.  We  show 
that,  typical  digital  equivalents  of  continuous- time  nonlinear  systems  obtained  under 
fast  sampling  routinely  satsify  this  condition. 

4.  Similar  comments  hold  true  for  linear  systems,  piecewise  nonlinear  systems,  and 
piecewise  linear  systems. 
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ABSTRACT 

Delta-operator  based  implementations  can  avoid  the  numer¬ 
ical  ill-conditioning  usually  associated  with  high  speed  shift- 
operator  based  implementations  of  discrete-time  systems. 
Moreover,  it  provides  a  unified  methodology  for  tackling 
both  continuous-  and  discrete-time  systems.  In  particular, 
it  has  been  shown  that,  delta-operator  based  balanced  re¬ 
alizations  can  offer  superior  coefficient  sensitivity  properties 
under  fixed-point  arithmetic.  In  this  work,  we  address  com¬ 
putation  of  balanced  realizations.  For  this  purpose,  given  a 
discrete-time  system,  the  relationship  between  its  shift-  and 
delta-operator  formulated  balanced  realizations  is  presented. 

L  INTRODUCTION 

Current  interest  in  delta-systems  (^-systems)  is  due  mainly 
to  two  reasons:  (a)  ^-systems  provide  superior  roundoff  noise 
[1-2]  and  coefficient  sensitivity  [3-4]  properties,  and  (b)  6- 
operator  makes  it  possible  to  treat  both  continuous-time 
(CT)  and  discrete-time  (DT)  systems  in  a  unified  man¬ 
ner  [5].  Recent  work  on  6-operator  based  implementation 
of  two-dimensional  (2-D)  DT  systems  contain  the  counter¬ 
part  to  the  shift-operator  (^-operator)  based  Roesser  lo¬ 
cal  state-space  (s.s.)  model  [6].  Balanced  (BL)  realiza¬ 
tion  of  such  models  and  coefficient  sensitivity  properties 
were  also  investigated.  Indeed,  given  a  2-D  DT  system, 
under  fixed-point  (FXP)  arithmetic  (and  mild  conditions), 
Roesser  6-model  was  shown  to  be  superior  to  the  Roesser 
^-model.  In  this  paper,  we  reveal  the  relationship  be¬ 
tween  BL  realizations  of  Roesser  6-  and  g^-models.  This 
makes  it  possible  to  use  techniques  available  for  compu¬ 
tation  of  g-BL  models  for  computation  of  6-BL  models. 
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IL  NOMENCLATURE  AND  PRELIMINARIES 

2.1.  Nomenclature 

and  K  denote  the  reals,  complex  numbers,  and  non¬ 
negative  integers,  respectively.  3?^^^  and  are  the  sets 

of  matrices  of  size  qx  p  over  3?  and  respectively. 

In  is  the  unit  matrix  of  size  n  x  n;  0  is  the  null  matrix  of 
size  g  X  p.  A*  and  denote  the  complex  conjugate  trans¬ 
pose  and  transpose  of  matrix  A  G  trace[A]  and  A* [A] 

denote  its  trace  and  z-th  eigenvalue.  llAjliP  is  its  Frobenius 
norm. 

In  the  1-D  case,  corresponding  g-  and  6-systems  are  re¬ 
lated  by  6  =  (g  —  1)/A  c  =  [z  ~  1)/A.  Here,  A  is  a 
positive  real  constant  (usually  the  sampling  time).  For  2-D 
systems,  subscripts  h  and  v  denote  horizontally  propagating 
(h.p.)  and  vertically  propagating  (v.p.)  subsystems  of  the 
corresponding  Roesser  local  s.s.  models,  rih  and  riy  denote 
the  sizes  of  these  h.p.  and  v.p.  subsystems.  We  use  n  to 
denote  n  =  rih  A  riy.  Ah  and  A^  are  positive  real  constants 
denoting  'sampling  times’  along  h.p.  and  v.p.  directions. 

We  use^  to  denote  A/^/n^  0At;/„^  E  Also,  and 

Ic  denote  Zhlnt,  ®  C  and  Chluh  0  Cyln^  G 

respectively. 

Corresponding  2-D  g-  and  6-systems  are  related  by  6h  = 
(^/i  l)/A/i  s  Ch  —  1)/ A/j  and  6^,  —  (g^  1)/ A^  K 

~  (z^  —  1)/A^;.  We  use  subscripts  6  and  g  to  differentiate 
between  corresponding  6-  and  g-systems;  for  example,  s.s. 
realization  of  a  given  DT  system  is  either  {A^,  5^ , 
if  implemented  based  on  6-operator  or  {Ag,  Bq,Cg,  Dq)  if 
implemented  based  on  g-operator.  The  following  notation 
is  also  used:  i^/'(c/i,  c^)|c^z  =  ^(c/i,  c^)l c,, and 

Cv=(*v-1)/A« 

G(z/i ,  Zt;)  }z_+c  —  1  \  • 


Stability  studies  of  g-  and  6-systems  involve  the  follow- 


ing  regions:  W,  =  {2  G  9  ;  |z|  <  1};  =  {{zh,Zv)  G  : 

|zh|  <  1,|2„|  <  1};  Wi  =  {c  G  3  :  |c+  1/A|  <  1/A};  = 

{(cfc,c„)  G  :  |cft  +  l/A/,1  <  1/Ah,  lc„  +  1/A„|  <  1}.  The 
corresponding  distinguished  boundaries  are  denoted  with  let¬ 
ter  T]  U.UT  is  denoted  by  Z7..  A  ^-system  polynomial  with 
all  its  roots  in  Uq  (for  the  1-D  case)  or  (for  the  2-D  case)  is 
said  to  be  stable.  The  corresponding  regions  for  a  (5-system 
polynomial  are  U$  (for  the  1-D  case)  and  Uf  (for  the  2-D 
case),  respectively. 

2.2.  Preliminaries 

First,  we  provide  a  brief  overview  of  relevant  material. 

Roesser  q-model  The  2-D  dynamical  system  under  consider¬ 
ation  is  assumed  to  be  linear,  shift- invariant,  strictly  causal, 
and  modeled  by  a  set  of  first-order  vector  difference  equa¬ 
tions  over  Given  such  a  p-input  and  qf-output  system,  its 
n^h-n^v  Roesser  local  s.s.  model  {Ag^  Bq^Cq^  Dq}  is  of  the 
form  [7] 


4"^ 


+ 


(1)1 

(2), 

«  J 


y(*,i)  =  \Cl 
=  [C,] 


x'‘(i,j) 


x‘'(*.j) 


+  [Dq]u(i,j), 


(2.1) 


where  u  G  W,  x'*  G  x"  G  5ft"”,  and  y  G  5ft«.  Also, 

G  Jft"'*^"'*,  G  5ft"”^"”,  etc.  Here,  (ij)  G  and 


Cs,Ds}  has  been  proposed  [6]: 

(5h[x'*](i,i)  _  x'*(i,i) 

|x'*(i,i) 


+ 


x’'(i,i) 

+  [B«]u(i,i); 
h 


(2) 


x^Ci,/) 


(2.6) 


where 


Ai  =  r'(A-4)i  B,  =  Ci  =  C,;  Di  =  D,.  (2.7) 

Here,  i  =  0  At;/„J  G  Note  that,  as  opposed 

to  its  corresponding  Roesser  g- model,  here,  one  must  also 
perform  the  following  computations: 

9h[x'']  =  x'*  +  Ah  •  ^h[x'‘];  g„[x’'](i,i)  =  x''  +  A„  •  (5„[x’']. 

(2.8) 

In  [6],  several  properties  of  this  Roesser  ^-model  (such  as, 
general  response  equation,  transition  matrix,  characteristic 
equation,  transfer  function)  are  elaborated.  Also,  it  is  easy  to 
see  that,  as  for  the  ^-model,  2-D  equivalent  transformations 
of  the  type 


’x^{i,i) 

0 

IT 

~  TTl 

x''(i,i) 

.x"(*,j). 

0  r(‘‘) 

x''{i,j)_ 

L  L  JL  1.  X 

(2.9) 

where  T^^'>  G  Ift"'*^"'*  and  G  are  nonsingular, 

yield  an  equivalent  2-D  s.s.  realization  {A(,Bs,C(,Ds}, 
where 


5h[x](i,i)  =  x(j-t-l,i)  and  5„[x](i, j)  =  x(f,i-l- 1).  (2.2) 

Usually,  X*  and  x”  are  called  the  h.p.  and  v.p.  local  state 
vectors  of  {A^,Bj,C,,D,}.  With  no  nonessential  singulari¬ 
ties  of  the  second  kind  on  ,  for  BIBO  stability,  one  requires 
[8] 

det[7, -AJ^O,  V(2h,2„)GW'.  (2.3) 


Roesser  6-modei  To  exploit  the  superior  finite  wordlength 
properties  of  ^-operator  implementations,  analogous  to  the 
1-D  case,  in  [6],  the  following  operators  are  defined: 


x(i+ l,i) -x(f,;)  qh[x](i,j)-x{i,j) 

^h[xj(U7)  = - - - 


•^^IxKui)  = 


Ah 

x(i,j  -1-  l)-x{i,j)  _  g4x](bi)  -x(i,i) 


A„ 


A„ 


(2.4) 

where  Ah  and  At,  are  two  positive  real  numbers.  Hence,  the 
following  relationships  are  applicable: 


gh  -  1. 

Ah  ’ 


6,.  = 


gt,  ^ 

A„ 


(2.5) 


Using  (2.4-5)  in  (2.1),  the  following  Roesser  6-model  {Aj,  Bj, 


As  =  TAsT-^\  Bs  =  TBs;  Cs  =  CsT'^;  Ds^Ds.  (2.10) 

Also,  {As,Bs,Cs,Ds)  and  {As,Bs,Cs,Ds)  have  the  same 
transfer  function.  With  no  nonessential  singularities  of  the 
second  kind  on  T/,  for  BIBO  stability,  one  requires 

det[B-Ai]/0,  V(ch,c„)GW^  (2.11) 


III.  GRAMIANS  AND  BL  REALIZATIONS 

3.1.  Gramians 

For  the  Roesser  ^-model,  gramians  are  taken  to  be  natu¬ 
ral  extensions  of  the  integral  expressions  of  their  1-D  coun¬ 
terparts  [9-10].  The  work  in  [6]  adopts  a  similar  approach 
in  proposing  gramians  for  the  (5-operator  case  as  defined  in 
[5].  In  what  follows,  (with  gramians  and 

Qf,)  and  {Aq,Bq,Cq,  Dq]  (with  gramians  Pq  and  Qq)  de¬ 
note  a  given  stable  2-D  DT  system’s  6-  and  ^-operator  bfised 
Roesser  models,  respectively. 


Definition  3.1.  [9-10]. 


{Aq  ,  Bq  ,  C 

Bq} 

are 

1 

ll 

dzh  dzy 

'  “  (2x^)2 

rfv 

r  qP  ^ 

Zh  Zy 

1 

ll 

dzh  dzy 

'  ~  (27ri)2 

^q^q 

Zh  Zy 

where  Fq(zh,Zv)  =  {h  —  Aq)  ^Bq  and  Gq{zh,Zv)  = 


2.  Gramians  of  {A^ ,Bi,Ci,Ds}  are 


Ps 


dch 


dcy 


(25ri)^  ^2  ^  *  1  +  AftCft  1  +  A„c„  ’ 


V 


GlGi 


dch 


dCy 


1  +  AhCh  1  +  AyCy  ’ 


For  convenience,  we  use  the  following  notation: 
{A,B,C,D}-^{A,B,C,D}:  Here,  A  =  TAT-\  B  =  TB, 
C  =  CT*^,  and  D  —  D,  where  T  is  of  type  (2.9-10). 

{Aq,Bq,CqyDq]'^-^{A^,BsyCs,Ds):  This  is  the  corre¬ 
sponding  (5-system  obtained  by  applying  (2.7). 

{AsyBsyCsyD^}^^{Aq,Bq,CqyDq]:  This  is  the  corre¬ 
sponding  ^-system  obtained  by  applying  (2.7). 


where  F3{chyCy)  =  {h  -  As)  ^Bs  and  Gs{chyCy)  = 

Cs{Ic-As)-K 

Lemma  3.1.  [6].  The  relationship  between  the  above  grami¬ 
ans  are 


P6  = 


1 


AjlAy 


Pq]  Qb  — 


AfiAy 


CQqC 


With  appropriate  partitions  incorporated,  this  is  equivalent 
to 


■  pW 

p(2)  ■ 

1 

pP] 

.P?'^ 

^8  -1 

Ah  Ay 

_ 1 

\Q?^ 

Moreover,  we  use  the  following: 

{AqB,BqByCqB,DqB}:  BL  realization  of  {Agy  Bq^Cqy  Dg} 

T 

obtained  via  {Ag,  Bg.CgyDg]  —^{AgByBgByCqByDgB]^ 
{AsB'^BsB)CsB^  BL  realization  of  {AsyBsyCsyDs) 

obtained  via  {As yBsyCsyDs]  -^{Asb ,Bsb,Csb,  Psb}- 
{AsB2q:BsB2q,CsB2q,DsB2q}-  ^-System  obtained  via 

{AsBjBsb,CsB,Dsb}  - HAsB2qyBsB2q,CsB2qiB6B2q}- 

{AgB26,BgB26,CgB26^BqB26}’  5-system  obtained  via 

{AqB  ,  BqB  ,  CqB  ,  DqB  }  ^{AgB26  j  BgB26  i  CgB26  ,  BqB26  }  • 

Lemma  3.3.  The  following  relationships  are  true: 

{Aq,Bq,CgyDg}  ^^{AsB2qyBsB2qiCsB2qyBsB2q}] 

T 

{Asy  BsyCsyDs}  --^{AqB26  ,  BqB26  J  CgB26  ^  BqB26}  ^ 


= 

=  diag{<r^;\ •  •  • 
=  diag{<r^^\  . . . 

^  V  ■ 

,  i  =  1,.. 

.,nh,  and 

j  = 

Lemma  3.2,  [6].  The  realization  [Asy  BsyCsy  Ds}  obtained 
with  a  nonsingular  transformation  of  the  type  in  (2.9-10) 
yields  the  gramians  Ps  =  TPsT*  and  Qs  =  T~^  Qs'F’^^- 
Eigenvalues  of  PsQs  invariant  under  such  a  transforma¬ 
tion.  The  situation  regarding  Roesser  g-model  is  completely 
equivalent. 

Definition  3.2.  [10].  Roesser  6-model  {AsyBsyCs.Ds}  is 
said  to  be  balanced  (BL)  if 


We  refer  to  crV 

Oy  '  ,  .  ,  Uj'*' 

as  the  Hankel  singular  values  of  h.p.  and  v.p.  subsystems, 
repectively.  The  situation  regarding  Roesser  g-model  is  com¬ 
pletely  equivalent. 

3.2.  Computation  of  BL  Realizations 

Computation  of  gramians  and  obtaining  BL  realizations  for 
g-systems  have  been  investigated  quite  thoroughly.  In  the 
1-D  and  2-D  separable  cases,  one  may  solve  Lyapunov  equa¬ 
tions  and  use  Laub’s  algorithm  [10-11].  In  the  2-D  non- 
separable  caise,  this  computation  is  not  that  easy;  however, 
several  techniques  have  been  developed  [10],  [12]. 

In  this  section,  we  provide  the  relationship  between  BL 
realizations  of  corresponding  6-  and  g-models.  This  allows  all 
available  techniques  for  gramian  computation  of  g-systems  to 
be  utilized  for  6-systems  as  well.  To  the  authors’  knowledge, 
such  a  relationship  is  not  available  even  for  the  1-D  case. 
Although  we  concentrate  on  the  2-D  case,  a  similar  argument 
may  be  developed  for  the  1-D  case. 


Proof.  Note  that,  AsB2q  =  4  +  ^A^b  =  4  +  ^TsAsT^  ^  = 
In  +  -  In)Tf^  =  TiAqTf\  since  =  4- 

The  remainder  may  proven  in  a  similar  manner.  ■ 

Lemma  3,4.  The  following  relationships  are  true: 
{AsB2q,BsB2qjCsB2q,B6B2q} 

C-l/2 

- ^  {AgB,  BgByCgByDqB}] 

{AgB26,BgB2S,  GqB26,  BqB26} 

ci/2 

— ^{AsB,BsB^CsB,  L)sb}^ 

Proof.  Note  that,  {Asb  ,  Bsb ,Csbi  Bss}  has  following 
gramians: 


r  v(^) 


Psb 


p(2) 

^6B 


^Psb 


(3)  v(^) 


Qsb  =  I 


Hence,  from  Lemma  3.1,  {AsB2q,  BsB2q,CsB2qy  B6B2q}  has 
the  following  gramians: 

PsB2q  =  A,Aj^^ 


Q6B2q  — 


(1) 
6 


(4) 

-^6  J 


^6D 


n(2) 

^6B 

4iLv(^) 

Ay,  ^6  J 


To  get  [AgByBqByCqBy  L)qB}j  we  need  to  simultaneously 
diagonalize  the  two  pairs  {A/j (At;/A4)E^^^}  and 


{AftA„E^/\(Ah/A„)E^‘*-’}.  By  applying  Laub’s  algorithm, 

_ 1/2 

we  get  these  two  transformations  to  be  ^h'  In,  and 


^(4) 


This  proves  the  first  part.  The  remainder  fol¬ 
lows  in  a  similar  manner.  ■ 

Corollary  3.5.  The  systems  {AgB,BgB,CqB,DgB}  and 
{AiB,BsB,CsB,DiB}  are  related  as  follows: 

Asb  =  r^'HAgB  -  b,b  =  r^'^BgB-, 

CsB  =  B>iB  —  DgB- 

Proof.  Note  that,  from  Lemma  3.4,  A^b  =  i~^{A6B2q—In)  = 
-  In)  =  C^/^AgB  -  /n)r‘^'-  The  rest 
follows  in  a  similar  manner.  ■ 

IV.  EXAMPLE 

We  now  consider  a  stable  3h-3v  2-D  separable  digital  filter. 
4.1.  Computations 

Numerical  values  are  displayed  via  FORMAT  SHORT  E  of 
MATLAB  [13]  which  was  used  for  all  computations.  Note 
that,  since  system  being  considered  has  A^^  =  0  (instead  of 
^g^  =  0),  relevant  equations  must  be  appropriately  modi¬ 
fied. 

Given  q-model  {^Ag,Bg,Cg,Dg). 


=  [6.5590e  -  01  -5.1574e  -  01  1.9341e  -  01  ] ; 

=  [6.3592e  -  02  -4.9875e  -  02  1.8540e  -  02] ; 

DgB  =  [9.4300e-03]. 


Corresponding  6-model  {As,  ,  Cj,  £>{}.  Let  us  select  A/,  = 


Delta^  - 

=  2.5000e  -  01. 

Accordingly,  we 

get 

aP  = 

■-4.00006  4-00 

4.0000e  4-  00 

0 

0 

-4.0000e  4-  00 

4.0000e  4-  00  ; 

_  1.53266  4-00 

-5.5444e  4-  00 

3.62686  4-  00 _ 

aP- 

■-2.7312e-01 

2.4760e  -  01 

2.6160e  -  02  ^ 

-1.1240e-01 

1.5824e  -01 

-8.9920e  -  02 

4.9780e  4-  00 

-2.2837e  4-  00 

8.2348e  4-  00  _ 

II 

o 

■-4.00006  4-00 

4.00006  4-  00 

0 

0 

-4.0000e  4-  00 

4.0000e  4-  00  ; 

1.52956  4-00 

-5.5272e  -f  00 

3.61006  4-00 

bP  =  [0  0  4f; 
bP  =  [0  0  4f; 

=  [1.1410e-02  -5.4000e-03  1.9560e-02]; 
=  [1.1640e-02  -5.4500e  -  03  1.9600e-02]; 

Ds  =  [9.4300e-03]. 


0 

0 

3.8315e-01 


l.OOOOe-bOO 

0 

-1.3861e  +  00 


0 

l.OOOOe  -f-  00 
1.9067e  +  00 


aP 


-6.8280e  -  02 
-2.8100e  -  02 
1.2445e  -t-  00 


6.1900e  -  02 
3.9560e  -  02 
-5.7092e  -  01 


6.5400e  -  03 
-2.2480e  -  02 
2.0587e  +  00 


aP  =  Ofs? 


0 

aP  0 

3.8238e-  01 


l.OOOOe  4-00 
0 

-1.38186  4-00 


0 

l.OOOOe  4-  00 
1.9025e  4-  00 


5W  =  [0  0  1]^; 

Rf)  =  [0  0  if; 

=  [1.1410e-  02  -5.4000e-03  1.9560e-02]; 
=  [1.1640e-  02  -5.4500e-03  1.9600e-02]; 
Dg  =  [9.4300e  -  03] . 


BL  q-model  {AgB ,  BgB,CgB ,  Dgs} ■ 


11 

■  8.6478e  -  01 

2.6806e  -  01 

-3.4799e  - 

02] 

-2.6806e  -  01 

5.8766e  -  01 

3.8402e  -  01 

_-3.4797e-02 

-3.8401e  -01 

4.5427e-01  _ 

.(2)  _ 
^qB  — 

■4.2940e-01 

-3.3765e-01 

L2689e  -  Ol' 

3.3771e-01 

-2.6511e  -01 

1.0134e-01 

1.27326  -01 

-9.7518e  -  02 

3.2423e  -  02 

4(3)  _  r 

^qB  -  ^ 

h 

11 

■  8.6486e  -  01 

2.6760e  -  01 

-2.6760e  -  01 

5.8692e  -  01 

-3.4952e  -  02 

-3.8661e-01 

-3.4949e  -  02 
3.8661e  -  01 
4.5071e  -  01 


[6.3568e-02  4.9879e  -  02  1.8565e-02f; 


=  [6.5595e  -  01  5.1555e-01  1.9416e-01]; 


BL  6 -model  {Asb  >  Bsb  ,  Csb  >  Dsb  }  • 


5.4089e  -  01 
1.0722e4-00 
1.3919e  -01 


1.0722e4-00 
-1.6494e4-00 
-1.53616  4-00 


-1.3919e-01 

1.5361e4-00 

-2.1829e4-00 


1.71766  4-  00 
1.35086  4-  00 
5.0926e  -  01 


-1.35066  4-  00  5.07556  -  01 
-1.06046  4-00  4.05376  -  01 
-3'.9007e  -  01  1.2969e  -  01 


0; 


d(1)  _ 
- 

d(2)  _ 

r(l)  _ 

Kyc  n  - 


(2) 

6B 

Dsb 


C' 


■-5.4054e-01  1.0704e4-00  -1.3980e-01 

-1.07046  4-00  -1.65236  4-00  1.5464e4-00 

_-1.3981e-01  -1.54646  4-  00  -2.1971e  4- 00 

[1.2714e-  01  9.9759e-02  3.7129e-02f; 
[1.31196  4-  00  1.03116  4-00  3.8833e-0lf; 
[1.31186  4-  00  -1.03156  4-00  3.8682e-01]; 
[1.2718e-  01  -9.9750e-  02  3.7080e-02]; 

[9.4300e-03]. 


4.2.  Simulations 

Normalized  frequency  response  of  {Ag ,  Bq^Cg^  Dg}  is 
Hg  and  that  of  {As ,Bs,Cs,Ds}  is  .Hs{{e^"^  - 1)/ 

Frequency  responses  are  evaluated  on 
=  {{^u^2)  e  3?'  :  a;,  ==  n,-  X  tt/N,  n,-  =  [-N  :1:  iV],  i  ^ 
1,2}  with  N  —  32.  For  comparison  purposes,  the  following 
measure  was  also  evaluated:  For  {zi,Z2)  ~  and 

(ci,C2)  -  -  l)/A,,(ei-=  -  1)/A,), 


1  max^2 

H{zi,Z2)  -  H{zi,Z2) 

1  maxg2 

H{ci,C2)  -  H{ci,C2) 

for  g^-models; 
for  6-models. 


H-ere,  H  denotes  the  ‘ideal’  frequency  response  where  each 
^  'coefficient  is  represented  in  ‘infinite’  precision;  H  denotes 
the  ‘actual’  frequency  response  where  each  coefficient  is  rep¬ 
resented  in  finite  precision. 

Fig.  (1)  shows  ^'max  versus  number  of  fractional  bits 
where  each  coefficient  is  represented  in  FXP  and  its  frac¬ 
tional  part  is  truncated  at  different  lengths;  integral  part  is 
represented  exactly.  Advantage  gained  by  BL  (5- model  over 
BL  g-model  is  about  3  bits. 

Fig.  (2)  shows  E'max  versus  total  number  of  bits  where 
each  coefficient  is  represented  in  FXP  and  its  total  (in- 
tegral-hfractional)  number  of  bits  is  truncated  at  different 
lengths.  Advantage  gained  by  BL  (5-model  over  BL  g-model 
is  only  about  1  bit.  This  modest  improvement  is  due  to  the 
large  A/j  and  being  used.  More  dramatic  improvements 
require  smaller  A/,  and  A^  [6].  But,  this  makes  (5-model’s 
coefficients  to  occupy  a  larger  dynamic  range.  To  circum¬ 
vent  this,  we  believe,  careful  scaling  of  filter  coefficients  is 
necessary.  We  are  currently  investigating  this  possibility. 

Fig.  (3)  shows  ^’max  versus  number  of  mantissa  bits 
where  each  coefficient  is  represented  in  FLP  and  its  num¬ 
ber  of  mantissa  bits  is  truncated  at  different  lengths.  Of 
course,  in  FLP,  dynamic  range  is  usually  of  no  threat. 

V.  CONCLUSION 

In  this  work,  we  have  presented  the  relationship  between  BL 
realizations  of  corresponding  6-  and  g-models.  This,  in  turn, 
addresses  computation  of  gramians  and  BL  realizations  of 
(5-models. 

In  the  FXP  case,  ^-model  is  better  whenever  A/^  <  1 
and  Av  <  1  [6].  However,  this  choice  must  be  carefully  done 
since,  in  FXP,  (5- models  tend  to  occupy  a  larger  dynamic 
range.  The  authors  are  currently  investigating  the  possibil¬ 
ity  of  incorporating  scaling  of  coefficients  so  that  low  values 
of  Ah  and  A^  may  be  used  to  expose  and  exploit  the  ad¬ 
vantages  of  ^-systems.  In  the  FLP  case,  such  a  limitation 
does  not  usually  arise,  and  ^-models  are  better  whenever  the 
system  matrix  eigenvalues  lie  within  a  certain  region  called 
the  MG-region  [14].  This  condition  is  typically  true  for  high 
Q,  narrowband  digital  filters  operating  under  high  sampling 
rates.  These  observations  indicate  that,  in  FLP,  for  compar¬ 
ative  performance  (with  respect  to  coefficient  sensitivity), 
(5-models  require  a  shorter  mantissa  length.  The  ensuing  im¬ 
plications  regarding  low  power  consumption,  low  cost  and 
weight,  and  high  speed  cannot  be  overemphasized.  The  au¬ 
thors  are  currently  completing  work  regarding  quantization 
noise  properties  of  the  6-model  developed,  where,  as  in  1- 
D  case,  improvements  over  the  corresponding  g'-model  are 
expected. 

We  must  mention  that  certain  difficulties  regarding  limit 
cycles  are  inherent  in  6-systems  when  FXP  arithmetic  is  used 
[15].  However,  this  problem  is,  for  all  practical  purposes, 
nonexistent  in  FLP  arithmetic.  Hence,  in  our  opinion,  for 
FLP  high  performance  applications,  the  6-model  developed 
provides  an  extremely  attractive  solution  that  avoids  numer¬ 
ical  ill-conditioning  typically  associated  with  high  speed  q- 


systems. 
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Abstract — By  developing  the  ^-operator  ana¬ 
log  of  the  Roesser  model,  state-space  realiza¬ 
tion  of  two-  and  multi-dimensional  ^-systems 
is  investigated.  The  corresponding  notions 
of  gramians  and  balanced  realization  are  also 
defined.  It  is  shown  that,  discrete-time  sys¬ 
tem  implementation  using  this  model  can 
yield  superior  coefficient  sensitivity  proper¬ 
ties. 


B.  Preliminaries 

Consider  a  linear,  shift-invariant,  strictly  causal,  p-input 
g-output  2-D  DT  system.  Its  n/ih-n^v  Roesser  local  s.s. 
model  {AyB^C^b}  takes  the  form  [12]: 


=  [i] 


y{ij)  =  [C"] 


+  [•D]u(i,i), 


(2.1) 


1.  Introduction 

Judging  by  its  performance  in  the  one-dimensional  (1- 
D)  case  [2],  [5-6],  one  is  led  to  expect  superior  coeffi¬ 
cient  sensitivity  and  roundoff  noise  performance  with  S- 
operator  implementation  of  two-dimensional  (2-D)  and 
multi-dimensional  (m-D)  discrete-time  (DT)  systems. 
With  this  in  mind,  (5-operator  analog  of  the  ^-operator 
Roesser  local  state-space  (s.s.)  model  [12]  is  developed. 
We  also  propose  the  notions  of  gramians  and  balanced 
(BL)  realization.  As  expected,  realization  using  this 
model  can  provide  superior  coefficient  sensitivity  prop¬ 
erties. 


where  u  €  W,  x'‘  €  ,  x’'  €  3?"*’,  and  y  €  3?^  x'^ 

and  are  the  h.p.  and  v.p.  local  state  vectors.  Take 
n  =  n/j,  -f  Ut,.  Also, 

=  x(i+  1, j);  9v[x](i,f)  =  x(t,;  +  1).  (2.2) 


In  what  follows,  we  use  matrix  partitioning  that  con¬ 


form  to  A  = 


A(i) 

i(3) 


A(2) 

i(4) 


B  = 


^(2) 


and  C  = 


(7^2)  j  ^  xhe  corresponding  2-D  characteristic  equa¬ 
tion  and  transfer  function  are 


II.  Nomenclature  and  Preliminaries 
A.  Nomenclature 

9i:  Reals;  Complex  numbers;  Matri¬ 

ces  of  size  q  X  p  over  and  /n:  n  X  n  unit  ma¬ 
trix;  A*,  trace[A],  ||A||f-  Conjugate  transpose,  trace, 


Unit  vector  in 


and  Frobenius  norm  of  matrix  A;  ej 
with  1  on  the  i-th  row; 

=  ELi  EJ=1  <7'’^  e 

For  q~  and  6-systems,  we  use  the  indeterminates  2:  and 

c,  respectively.  For  1-D  systems,  6  =  {q  —  1)/t  c  = 

[z  —  l)/'r,  where  r  is  a  positive  real  constant,  usually 

_ 

the  sampling  time.  Let  ~  {(c/i,Cv)  G  ^  |c/i  -f- 
1/uJ  <  ^/'^hAcv  +  l/^z;|  <  !}■  is  its  boundary. 

The  corresponding  (/-system  regions  are  denoted  with  the 
subscript  q. 


K.P.  and  P.H.B.  gratefully  acknowledge  the  support  received 
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det[/^  -  A]  =  det[zh,In^  ©  -  A]; 

Hizh,Zy)  =  CiI,  -  A)-^B  +  D, 

where  z/,,z„  €  0“  /z  =  ©  Zvln^,  C  With  no 

nonessential  singularities  of  the  second  kind  (NSSK)  on 
{A,B,C,D}  is  BIBO  stable  iff  [3] 


det[h  -  A]  0,  V{zi^,zv)  e  (2.4) 

III.  2-D  5-Model 

A.  Local  s.s.  model 

Analogous  to  the  1-D  ca.se,  define  5;i[  ]  and  5„[  ]  as 

x(i  +  l,i)  -  x(t,j)  _  ?/Jx](t,  j)  -  x(i,;) 

Th  T/i 

x(t,i  +  1)  -  x(i,  j)  _  (?t;[x](i,i)  -  x{i,j) 

Ty  Ty 


^/iM(j,i)  = 


(3.1) 


Here  and  Tv  are  positive  real  constants  denoting  the 
^sampling  times’  along  h.p.  and  v.p.  directions,  respec¬ 
tively.  Note  that 

=  1 -f  qv  =  l+ry6y,  (3.2) 


where  f(u)  :=  ^ 


(0,0)<(h,k)<( 


if'- 

‘•J)^  0 


Let  le  =  Ckln^  0Ct,/„„  e  Then,  the  2-D  6- 

model’s  characteristic  equation  and  transfer  function  are 


and  letting  t  =  ©r„/„„]  € 


-^n+ry  Q  5„/„„  J  [x'-Ct-.i)]  • 


det[/c  -  A]  -  ;^^^clet[/^  -  i]|j 

jCt/)  —  ■^(2/i,2rv)|z— .ci 


Using  (3,3)  in  (2.1),  we  get 


hl^'^Khj)]  -fA-\  fx'‘(i.j)1  iV 


where 


Zh  =  l  +  TkCh,;  Zy=l  +  TvCv.  (3.10) 


.  .  ■  rA(i)  /l(2)l  „  .  [5(1)1  ,  ^  . 

where  A  =  ^^(3)  ^(4)  J  ,  B  =  ^ ^(2)  J  ,  and  C  = 

[c(i),C(2)].  In  addition,  we  need  to  perform 

=  x*'+r;i-5/i[x*];  9^[x’']  =  x’'  +  r„-6,;[x’'].  (3.5) 


Prom  now  on,  the  variable  transformation  in  (3.10)  is 
denoted  by  c  — )•  z  or  z  — >•  c  whatever  is  appropriate. 
Nonsingular  transformations  of  the  type 


_  fT-fi 


J  ^  ^  J  ’ 


(3,11) 


where  T  =  0  yield  the  equivalent  2-D  s.s. 

realization  {A,  5,(7,  D},  Here, 

A  =  TAT-^\  B  =  T5;  C  =  CT"^;  D  =  D,  (3.12) 


With  no  NSSK  on  T/ ,  {A,  5,  C,  D]  is  BIBO  stable  iff 


A  =  /n  0  rA;  B  =  tB;  C  =  C;  D  =  D.  (3.6) 
5.  Properties  of  the  2-D  8-model 

Most  of  the  following  properties  may  be  derived  in  a  man¬ 
ner  that  is  exactly  analogous  to  that  in  [12]. 

The  transition  matrix  A*’-^  of  the  6-model,  may  be 
recursively  computed  from 

r  0,(t,i)  =  (0,0); 

\Inh  ®  ^n„],  (j,i)  =  (0,  0); 

r/n,  01  U(l)  A(2)1  ^ov 

/!*’•'  =  <  [  0  oj^  [  0  0  J  ’iLJj-ll.U)- 


'0  0  1  ^  [  0  0  1 
.0  /r.J'^''[A(3)  A(^)J 

— ^0,1  ”1  ^  elsewhere. 


det[/o  -  A]  ^  0,  V(c;,,c^)  €  Us.  (3.13) 

C.  Gramians 

The  gramians  of  2-D  (^-systems  are  taken  to  be  natural 
extensions  of  the  integral  expressions  of  their  1-D  coun¬ 
terparts  [11].  We  will  adopt  a  similar  approach.  In  what 
follows,  we  consider  the  1-D  (or  2-D)  stable  6-system 
{A,  5,0,5}  with  gramians  P  and  Q.  The  correspond¬ 
ing  g-system  is  {A,  5,  (7,  D)  with  gramians  P  and  Q. 

1-D  case.  The  gramians  are  defined  in  [10]. 

Definition  3.1.  [10].  The  gramians  are  the  solutions  to 
the  Lyapunov  equations 

A5  -h  FA’*'  +  r  ■  AFA*  =  -55*; 

A*Q  ^QA  +  r  ■  A*QA  -  -C*C. 


The  general  response  of  the  6-model  is 


Lemma  3.1.  The  gramians  satisfy  the  integral  expres- 


x'‘(i,i) 


‘  ij-fc  x'*(0,^•) 
-  0 


FF*  ■  ;  Q  =  — 

1  +  rc  27rji 


1  +  rc 


+  2_^  A*  [x^(/i,0)  J 

h  —  O 


where  F(c)  =  (cln  -  A)  ^5  and  G{c)  =  C{cln  —  A)“L 
Moreover,  F  rP  and  Q  =  Q/r. 


Proof.  Substitute  A  =  In  ’h  'tA,  B  =  rB^  C  =  and 
D  ~  D  [10]  in  the  equations  in  Definition  3.1,  and  note 
the  integral  expressions  for  P  and  Q  in  [8].  ■ 

2~D  case.  With  Lemma  3.1  in  mind,  we  have 
Definition  3.2.  The  gramians  are 


P  ^ 


dcjl  dCy 

1  +  1  +  '^vCv  ’ 

dcfi  dcv 

1  1  +  'J'vCv  ’ 


where  P  = 


and  Q 


qW  qW 

Q(3)  q(4) 


■p(l)  p(2) 

P(3)  p(4) 

Also,  F(cy,,Ct,)  =  (Ic  -  A)-^B  =  and 

G(cf,,c^)  =  C(Ic  -  A)-^  =  [gi,...,gn]- 

Remarks. 

1.  Note  that,  {Ic  —  A)~^|c— m  =  {Iz  —  A)~^t,  and 


P|c^z  =  F;  G|c^z  =  G  •  r.  (3.14) 


when  {A,B,C,D}  is  locally  reachable  and  observable, 
p(i),  p(4)_  Q(i)_  and  (5(4)  are  each  p.d. 

Separable  systems.  A  separable  (in  denominator)  2-D 
^-system  will  have  A^^^  =0  (and/or  A^^)  =  0)  and  all 
ofF-diagonal  submatrices  of  P  and  Q  are  zero.  The  di¬ 
agonal  submatrices  may  be  computed  through  two  pairs 
of  Lyapunov  equations  [11].  Clearly,  a  separable  2-D  q- 
system  yields  a  separable  2-D  6-system. 

Theorem  3.6.  Let  {A,  JB,  C,  D}  be  separable  with  A^^^  = 
0.  Then,  P^^^  ~  =  0  and  ~  0,  and 

A(i)pO)  +  p(DA(ir  q.  r^A(^)pWA(^y 

A(^)*Q(i)  +  Q(^)A(^)  +  r;,AO)*Q(^)A(^) 

=  -[g(1)  PWa(3)]*[c(i)  pWA(3)]/r,; 

A(4)p(4)  +p(4)^(4)*  +r,A(")p('‘)A('‘)' 

=  -[p(2)  a(3)5(i)]  [p(2)  A(3)s(i)]*/rft; 

+  q(4)a('‘)  +  r„A(^)*Q(‘‘)A('‘) 


2.  Definition  3.2  is  completely  analogous  to  the  1-D  and 
2-D  ^-systems  [7],  [llj. 

Lemma  3.2.  P  =  r^TyP  and  Q  =  rh,TvT~^Qr~'^ , 

Proof  Consider  P  in  Definition  3.2.  Use  c  — >•  z,  (3.14), 
and  definition  of  gramians  for  2-D  ^-systems  [llj.  B 
The  following  are  in  complete  analogy  with  2-D  q- 
systems. 

Lemma  3.3.  The  gramians  may  be  represented  as 


oo  oo 

iz=0  j  =  0 
oo  oo 

Q  =  -L-r  ■  A’--’*C*GA‘--’'  •  r. 


t=0  i=o 


where,  for  (ij)  =  (0,  0),  Mij  =  0,  and,  for  (ij)  >  (0,  0), 


Mij  z::  A*- 


-Li. 


0 


0 

5(2) 


Lemma  3.4-  Let  {A,  5,  C,  D}  with  gramians  P  and  Q  be 
an  equivalent  system  as  in  (3.10-11).  Then,  P  —  TPT* 
and  Q  =  QT~^ .  Moreover,  the  eigenvalues  of  PQ 

and  PQ  are  invariant. 

Definition  3.3.  {A,5,C,  D}  is  said  to  be  balanced  if 


5( 


r(i)  ^(1) 


.(1) 


P(4)  =  Q(4)  =  E(^) 


}  and 


Q(i)  ^  5^(1)  ^  diag{crj^ 

(4)  ^(4) 

If  the  diagonal  submatrices  of  P  and  Q  are  each  posi¬ 
tive  definite  (f^-d.),  a  BL  realization  may  be  obtained  [4]. 
Regarding  this,  we  have 

Lemma  3.5.  Local  reachability  and  observability  of 
{A,  5,  C,  D)  and  { A,  5,  C,  £>}  are  equivalent.  Moreover, 


Here,  5(^)  =  and  S(^)5(^)*  r^ryP^'^fi 


IV.  Coefficient  Sensitivity 

By  generalizing  a  certain  sensitivity  measure,  Lutz  and 
Hakimi  [9]  have  addressed  sensitivity  minimization  of 
MIMO  1-D  CT  systems.  The  SISO  2-D  ^-operator  case 
is  in  [7].  In  what  follows,  we  study  the  coefficient  sen¬ 
sitivity  of  the  2-D  6-model  in  section  III.  We  follow  a 
more  direct  approach  using  Kronecker  product  formula¬ 
tion  and,  hence,  the  results  are  applicable  to  the  more 
general  MIMO  case.  Using  [l],  we  may  show 

^  A^Sh  —  [In  ^  G]  ’  U  nXn  ’  [In  ^  P]  (4.1) 

i^hi  ^v)  “  [In  ^  G]  ’  U nxp  (4.2) 

i^v)  —  P qXn  '  [In  ^  (‘^*^) 

‘^d(^/i)Cv)  —  PqXp  ('fA) 

Lemma  4.1.  The  quantities  in  (4. 1-4. 4)  are  given  as 


5  a  := 


5r 


5c  = 


gi 


4'^ 


&n 


AqV 


[fi*  fn]; 


•  f 


(1)*  1 


•  f, 


(</)* 


£^1,1 

■■ 

^<7iP  _ 

Here,  denotes  a  (g  x  p)  null  matrix  except  its  j-th 

row  which  is  f  *  and  denotes  a  (g  x  p)  null  matrix 
except  its  j-th  column  which  is  g,*. 

Proof.  This  may  be  shown  through  the  results  in  [1]  and 
simple  yet  tedious  algebraic  manipulations.  ■ 

Corollary  The  quantities  S/^ ,  *5'^  ,  Sc  ^  arid  S/)  of  the 
(5-model  and  the  quantities  5^,  and  of  the 
corresponding  g-model  are  related  by  Sa\c-*z  —  '^S^, 
Sb\c^z  =  Sc\c-^z  =  S^j  and 

where  T  =  rj^In^q  0  Tyln^jq  €  . 

Proof  Apply  (3.14)  to  Lemma  4.1.  ■ 

To  proceed  further,  we  utilize  the  following 
Definition  4.1.  Let  H{ch,Cv)  be  a  bivariate  matrix¬ 
valued  function  that  is  analytic  on  .  Then, 

{iTTjy  J  2 
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Remark.  This  norm  is  extensively  utilized  in  related  work 
[7]  due  mainly  to  the  fact  that  it  leads  to  tractable  re¬ 
sults.  This,  and  our  desire  to  make  a  comparison  with 
the  corresponding  g-model,  are  the  primary  reasons  for 
its  use  here. 

We  now  define  the  absolute  sensitivity  measure 

M  =  115^11?  +  hssWl  +  -I|5cll^  +  -1|5dIII  (4.5) 
p  q  pq 

Remarks. 

1.  The  use  of  different  norms  is  for  mathematical  feasi¬ 
bility  and  tractability  [7],  [5]. 

2.  The  weights  associated  with  each  term  in  (4.5)  may 
be  thought  of  as  averaging  factors  per  inpui/ouipui. 

3.  Due  to  (3.5),  M  should  contain  ||5r7,||  and  ||5r^||. 
However,  we  assume  that  and  Ty  are  selected  such 
that  each  possess  exact  binary  representations.  Hence, 
these  additional  terms  are  neglected. 

Using  an  argument  similar  to  that  in  [7],  one  may  show 
the  following: 


<  trace[P]  •  trace[r(3r] 

(4.6) 

PbIIz  =  P  •  trace[rQr] 

(4.7) 

IIScIll  =  q  ■  trace[/>] 

(4.8) 

1150112  =P9 

(4.9) 

Combining  (4.5)  with  (4.6-9),  we  get 

M  <  M  =  (trace[P]  -{-  l)(trace[r(5'r]  4-  1).  (4.10) 


It  is  customary  to  perform  a  minimization  of  M.  Hence, 
one  attempts  to  characterize  those  {A,  B,C,  D}  that  are 
‘bound  optimal^  with  respect  to  M.  Analogous  to  2-D 
g-systems  case  [7],  one  may  for  instance  show  that  a  BL 
realization  (modulo  an  orthogonal  nonsingular  transfor¬ 
mation)  is  ‘bound  optimal’  with  respect  to  M. 

Compared  to  a  g-system,  its  6-system  counterpart 
yields  a  smaller  M  whenever  trace[Q]  >  trace[rQr],  that 
is, 

(1  —  r^)  •  trace[(5^^^]  -h  (1  —  r^)  •  trace[(5^'^^]  >  0.  (4.11) 

Note  that,  with  the  local  reachability  and  observability 
assumption  of  {A,  B,C,  £)},  p.d.  of  and  (and 
hence  of  and  Q^^^)  guaranteed.  Thus,  (4.11)  is 
satisfied  if  r/^  <  1  and  <  1. 

VII.  Conclusion 

We  have  developed  the  6-operator  analog  of  the 
Roesser  local  s.s.  model.  Notions  of  gramians  and  BL 
realization  are  also  proposed.  As  is  expected,  under  mild 
conditions,  this  model  offers  superior  coefficient  sensitiv¬ 
ity  properties. 
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Abstract 

This  paper  addresses  the  robust  asymptotic  and  BIBO  (bounded-input  bounded-output)  stability  of  a  class 
of  linear  shift-variant  multidimensional  systems.  Using  a  shift-invariant  comparison  system,  necessary  and 
sufBcient  conditions  for  the  stability  of  the  entire  family  of  systems  are  derived. 

1  Introduction 

Results  addressing  the  robust  stability  problem  for  1-D  discrete  interval  polynomials  have  generated  mterest 
in  analogous  results  for  the  m-D  case.  Yet  even  in  the  work  on  shift-invariant  m-D  systems,  only  a  few 
results  address  the  m  >  2  case  [1,  2].  As  for  1-D  systems,  conditions  for  the  robust  stability  of  shift-variant 
m-D  systems  are  more  restrictive  than  for  the  shift-invariant  case.  Some  recent  results  concerning  the  robust 
stability  of  shift-variant  m-D  systems  can  be  found  in  [3,  4,  5]. 

This  work  was  supported  in  part  by  funds  from  the  Office  of  Naval  Research  Grant  #N00014-94-l-0387  and  the  SAE 
Foundation. 
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Ill  [6],  the  authors  investigated  the  BIBO  stability  of  a  class  of  shift-invariant  2-D  systems  having  a 
nonessential  singularity  of  the  second  kind  (NSSK)  on  the  distinguished  boundary  of  the  unit  bidisk.  This 
paper  addresses  what  happens  when  we  consider  a  3hift-vari2mt  uncertain  m-D  system.  In  particular,  we 
wish  to  determine  whether  a  member  of  the  family  of  shift-variant  systems  represented  by  a  corresponding 
interval  system  may  have  a  singularity  on  the  distinguished  boundary  of  the  unit  poly  disk  (T^)  and  still  be 
asymptotically  and/or  BIBO  stable. 


2  Notation 

The  work  that  follows  requires  some  definitions  and  notation. 


J^S' 

cT 

fjmi 


h  i 
yin) 

Hin) 

h_in) 

Nj 

I 

J 


The  first  m-D  hyper  quadrant. 

The  closed  unit  polydisk:  {(z)  :  \zi\  <  1,  i  =  1,  •  *  •, ni} 

The  open  unit  polydisk:  {(z)  :  |zj|  <  1,  i  =  1,  •  •  •,  m} 

The  distinguished  boundary  of  unit  polydisk;  {(z)  :  jzi]  =  1,  i  = 

The  spatial  vectors  (ni ,  •  •  * ,  n^i),  (ii ,  *  •  • ,  *m),  and  (ii ,  •  •  • , im)- 
The  output  of  the  m-D  system. 

The  input  of  the  m-D  system. 

The  shift-varying  coefficient  of  a  shifted  output  in  a  m-D  difference 
equation.  (For  example,  in  a  2-D  difference  equation,  a(3,2)(ni,n2)  is 
the  coefficient  of  y(ni  —  3,n2  —  2).) 

The  shift-varying  coefficient  of  a  shifted  input  in  a  m-D  difference 
equation. 

The  order  of  the  m-D  system  in  the  rij  direction,  j  =  1,  •  •  -  jm. 

{(*1, •••,»».)  :  0  <»k  <  and 

{(ii.  -.Jm)  :0<jk<Nk,k=  and 
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x+d)  >  |x(i)l 

y+(i)  >  |j/(i)l.  Vi6  7C 


Note  that  for  each  n  €  Wq",  we  may  write  a  shift  invariant  difference  equation  with  uncertain  coefficients 
belonging  to  the  intervals  in  (2): 

via)  =  ^  “iJKii  -  i)  +  ^  “  i) 

i€X  i€J 

where 

ai€[-af,af],  Vier 
biGl-bf.bf],  \/i€j 
at,bl>0 
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The  results  presented  here  make  use  of  the  following  Lemma  [7]: 

Lemma  1  The  shift-variant  uncertain  system  (1)  is  asymptotically  (BIBO)  stable  if  and  only  if  the  shift- 
invariant  system  (6)  is  asymptotically  (BIBO)  stable. 

We  wish  to  know  if  it  is  possible  for  a  family  of  shift-variant  systems  to  have  a  shift-invariant  member  (4)  with 
a  singularity  on  T"  and  still  be  asymptotically  or  BIBO  stable.  In  addition,  must  the  member  producing 
such  a  singularity  be  the  one  with  oi  =  af  and  bj  =  6^ ,  Vi  6 1  and  Vj  6 

4  Main  Results 

The  following  Corollary  arises  as  an  implication  of  Lemma  1; 

Corollary  2  If  the  shift-invariant  interval  transfer  function  (5)  is  asymptotically  stable  and  has  a  member 
with  a  singularity  on  T”,  then  the  shift-variant  family  of  systems  (1)  is  asymptotically  stable. 

Proof:  If  the  interval  system  (5)  is  asymptotically  stable,  then  the  majorant  system  (6)  is  also  asymptotically 
stable,  since  it  is  a  member  of  (5).  By  Lemma  1,  we  can  then  conclude  that  the  shift-variant  system  (1)  is 
asymptotically  stable. 
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Remark:  Given  that  the  output  mask  of  the  majorant  system  (6)  is  at  least  two-dimensional,  the  following 
expression  gives  a  necessary  and  sufficient  condition  for  the  asymptotic  stability  of  (6)  [3]. 

Theorem  3  If  the  majorant  system  transfer  function  (6)  has  a  singularity  on  and  no  other  singularities 
mlT^ ,  then  the  shift-variant  family  of  systems  (1)  is  BIBO  unstable. 

Proof:  Since  Lemma  1  gives  a  necessary  and  sufficient  condition  for  the  BIBO  stability  of  (1),  we  need  only 
show  that  the  majorant  system  (6)  is  BIBO  unstable  whenever  it  possesses  a  singularity  on  T™. 

An  m-D  transfer  function  cannot  be  BIBO-stable  if  it  has  singularities  on  T”*  unless  the  singularities  are 
nonessential  singularities  of  the  second  kind  (NSSK’s).  Because  the  majorant  system  has  a  singularity  on 
T™  and  no  other  singularities  in  U  ,  we  have  from  [3]  the  following  condition  on  the  coefficients  of  2?2(i) 
in  (6): 

Clearly,  02(2)  ^iH  have  a  zero  at  (zi ,  •  •  ■ ,  Zm)  —  (li ' '  ’  >  !)•  Since  none  of  the  in  (6)  are  negative,  1^2(1) 
cannot  have  a  zero  at  (1,  •  •  • ,  1).  Thus  the  singularity  at  (1,  ■  -  - ,  1)  is  a  singularity  of  the  first  kind,  or  a  pole, 
and  thus  ^2(1)  is  not  BIBO  stable.  From  Lemma  1,  the  shift-variant  system  (1)  is  also  BIBO  unstable.  O 


5  Conclusion 

In  this  paper  we  used  a  shift-invariant  majorant  system  to  derive  conditions  for  the  robust  stability  of 
shift-variant  m-D  systems.  In  particular,  we  examined  the  case  of  systems  whose  equivalent  shift-invariant 
interval  system  representation  has  a  singularity  on  I'”*  and  no  other  singularities  in  U  .  The  following 
remarks  discuss  implications  of  the  results  presented  here. 
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•  The  stability  of  the  majorant  system  whose  transfer  function  is  given  by  (6)  depends  only  on  the 
denominator.  The  numerator  cannot  have  a  zero  at  (z^,  •  •  • ,  Zm)  =  (1,  -  *  • ,  1),  so  the  system  cannot 
have  an  NSSK  on 

•  If  the  interval  system  (5)  contains  a  member  with  a  singularity  on  7^,  then  the  shift- variant  family  of 
systems  (1)  may  be  robustly  asymptotically  stable  (Corollary  2),  but  cannot  be  robustly  BIBO  stable 
(Theorem  3). 

•  The  intervals  to  which  the  coefficients  of  (1)  belong  may  be  subintervals  of  [—af,af]  and/or  [— 6^ ,  it]. 
When  such  subintervals  have  the  same  upper  limits  as  their  corresponding  intervals,  the  condition 
derived  here  is  still  necessary  and  sufficient  for  the  stability  of  the  shift-variant  system.  When  the 
upper  limit  of  any  of  the  subintervals  is  not  equal  to  the  upper  interval  limit,  we  have  a  sufficient  but 
not  necessary  condition  for  robust  asymptotic  stability. 

•  It  is  possible  to  construct  stabilizing  perturbations  for  a  nominal  BIBO  stable  system  with  an  NSSK 
on  T^.  Some  directions  of  perturbation  will  result  in  a  BIBO  stable  family  of  systems.  This  allows 
us  to  exploit  the  frequency  response  characteristics  of  low  order  filters  with  NSSK’s  on  as  long  as 
we  guarantee  that  perturbations  from  the  nominal  system  are  constrained  to  directions  that  result  in 
robust  stability. 
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Abstract 

This  paper  addresses  the  BIBO  (bounded-input  bounded-output)  stability  of  a  class  of  discrete  2-D  transfer 
functions  in  the  presence  of  nonessential  singularities  of  the  second  kind  (NSSK’s)  on  the  unit  bidisk.  Con¬ 
ditions  under  which  the  double  bilinear  transformation  (DBT)  preserves  stability  are  derived.  The  results 
presented  here  also  extend  the  class  of  systems  whose  stability  can  be  predicted.  Use  of  the  inverse  DBT  to 
produce  a  continuous  equivalent  of  the  discrete  2-D  transfer  function  allows  easy  application  of  a  continuous- 
domain  equivalent  of  a  criterion  developed  by  Dautov.  The  necessary  and  sufficient  condition  for  stability 
derived  in  this  work  provides  a  simple  check  for  the  class  of  systems  under  consideration.  From  this  class  of 

systems,  it  is  also  possible  to  construct  stable  pairs  of  mutually  inverse  transfer  functions. 

This  work  was  supported  in  part  by  funds  from  the  Office  of  Naval  Research  Grant  #N00014-94-l-0387  and  the  SAE 
Foundation. 
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1  Introduction 


In  the  study  of  multidimensional  systems,  the  problem  of  assessing  the  BIBO  (bounded-input  bounded- 
output)  stability  of  a  2-D  system  at  a  nonessential  singularity  of  the  second  kind  (NSSK)  remains  a  salient 
research  issue.  For  2-D  recursive  digital  filters,  Goodman  [1]  showed  that  even  if  the  transfer  function  has 
one  or  more  NSSK’s  on  the  unit  bidisk,  it  may  still  be  stable.  Since  this  important  paper,  other  researchers 
have  explored  the  issue,  trying  to  learn  more  about  the  behavior  of  such  systems  in  the  presence  of  NSSK  s. 

Contributions  in  this  area  include  the  derivation  of  necessary  and/or  sufficient  conditions  for  stability 
that  improve  upon  previous  results  [2,  3,  4,  5],  as  well  as  the  extension  of  Goodman  s  results  to  the  n-D 
case,  where  n  >  2  [6,  7].  Approaches  to  this  problem  vary  widely.  In  [3],  Alexander  and  Woods  present  a 
necessary  condition  based  on  the  direction  of  tangents  to  the  algebraic  curve  of  the  denominator  polynomial 
at  a  zero  on  the  unit  bidisk.  In  [4],  Roytman,  Swamy,  and  Eichman  use  a  resultant  method  to  test  for  /i- 
cind  /2-stability.  Recall  the  necessary  and  sufficient  condition  for  /i-stability: 

X)  X  I 

m=0  n=0 

where  /i(m,  n)  is  the  impulse  response,  or  inverse  Z-transform  of  H{z\,Z2)‘. 

00  C» 

H{zx,Z2)  =  X 

m=0  n=:0 

For  /2-stability  we  require  the  impulse  response  to  be  square-summable; 

00  00 

m=0  n=:0 

Dautov’s  approach  [2]  to  determining  the  BIBO  stability  of  a  2-D  digital  filter  in  the  presence  of  an  NSSK 
at  (21,^2)  on  the  distinguished  boundary  of  the  unit  bidisk  involves  taking  a  limit  as  (^1,2:2)  approaches 
(zi,Z2).  The  path  taken  in  this  limit  must  be  in  the  open  unit  bidisk.  For  an  NSSK  at  (1, 1),  consider  the 
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path: 

zi  =  l-y^  +  jy,  |y|  <  1 

Z2  =  Zi- 

As  y  0,  (zi,  Z2)  approaches  (1, 1).  Dautov  showed  that  if  the  limit  of  H{zi,Z2)  exists  along  this  path,  then 
H{zi,Z2)  is  BIBO  stable. 

Reddy  and  Jury  base  their  work  [5]  on  Dautov's  results.  They  translate  Dautov’s  criterion  to  the 
continuous  domain  using  the  inverse  double  bilinear  transformation  (DBT).  The  DBT  maps  a  continuous 
transfer  function  to  a  discrete  function  using 

where  without  loss  of  generality,  Ti  =  Tj  =  2.  The  NSSK  at  (zi,Z2)  =  (1,1)  corresponds  to  an  NSSK 
at  (si,S2)  =  (0,0).  Reddy  and  Jury  check  the  stability  of  the  continuous  function  to  infer  the  stability 
characteristics  of  the  corresponding  discrete  transfer  function. 

The  bilinear  transformation  is  widely  used  in  the  design  of  1-D  recursive  digital  filters,  and  the  DBT  has 
been  applied  to  2-D  digital  filter  design  [8,  9,  10].  The  1-D  bilinear  transformation  is  known  to  preserve 
stability,  but  in  the  2-D  case,  Goodman  has  shown  in  [11]  that  it  is  possible  to  apply  the  DBT  to  a  stable 
continuous  transfer  function  and  obtain  a  discrete  function  that  is  unstable. 

The  authors  of  [12]  formulate  necessary  and  sufficient  conditions  for  the  BIBO  stability  of  mutually 
inverse  pairs  of  2-D  transfer  functions  having  NSSK’s  on  T^.  These  conditions  are  based  on  the  order  of 
numerator  and  denominator  zeros  on  T^. 

This  paper  presents  a  result  regarding  the  stability  of  a  class  of  discrete  transfer  functions  whose  inverse 
DBT  has  a  particular  form.  We  then  give  a  sufficient  condition  for  the  BIBO  stability  of  a  class  of  2-D 
continuous  transfer  functions  that  have  NSSK’s  at  (si,  53)  —  (00,00).  This  will  allow  us  to  gain  insight  into 
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the  effect  of  the  DBT  on  stability;  i.e.,  the  conditions  under  which  a  continuous  system  is  stable  and  the 
corresponding  discrete  system  is  unstable.  Previous  work  on  the  stability  preserving  properties  of  the  DBT 
can  also  be  found  in  [13].  Finally,  we  show  that  a  class  of  BIBO  stable  transfer  functions  with  stable  inverses 
cam  be  constructed  from  the  class  of  systems  under  consideration. 


2  Notation  and  Problem  Formulation 


closed  unit  bidisk 
open  unit  bidisk 
distinguished  boundary  of  unit  bidisk 


The  work  that  follows  requires  the  following  notation: 

:  k«i  ^  1>  *=1.2} 

=  {(21,^2)  :  k.|  <1.  *  =  1>2} 

r2  =  {(zi,Z2):k.|  =  l,  *‘=1.2} 

A^  =  {(si,S2):Re(si)>0,  lsf|  <  00,  i=l,2} 

=  {(si,S2)  :  Re(s,)  >  0,  |s,|  <00,  i  =  1,2} 

^g  =  {(5i,S2):R«(s.)  =  0,  |si|<oo,  *=1,2} 

We  will  examine  a  class  of  discrete  systems,  denoted  by  if(zi,  ^2)1  whose  DBT  has  the  following  form: 


K 


Hisi,S2)  = 


JJ(1  +  a, Si  +  5jS2) 
N{si,S2)  t=l _ 

D(si,S2)  '  ^ 

J|(l  +  C<Si  +  diS2) 
i=l 


(1) 


which  corresponds  to  the  following  class  of  discrete  2-D  systems; 

K 

JJ[(1  +  Oi  +  6i)  +  (1  —  U«  +  +  (1  +  —  h)22  +  (1  —  Ut  — 

„  ,  .  _  NDizi,Z2)  <=1 _ _ _  (2) 

i=:l 

Note  that  the  discrete  system  has  an  NSSK  at  {zi,Z2)  =  (— 1,— 1).  Studying  the  asymptotic  behavior  of 
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H{si,S2)  as  Si  and  S2  approach  oo  will  tell  us  whether  or  not  the  system  is  stable  at  the  NSSK.  Note  that 
this  approach  differs  from  that  of  Reddy  and  Jury  [5]  in  that  while  they  examine  NSSK’s  at  (zi,  Z2)  =  (1, 1), 
we  study  the  behavior  of  the  transfer  function  at  a  different  location  on  T^;  (-1,-1).  We  do  this  because 
the  path  for  (si,S2)  -+  (00,00)  in  the  limit  is  easier  to  work  with  than  the  path  for  (si,  S2)  -♦  (0,0). 

We  impose  the  following  conditions  on  S2): 

•  The  DBT  of  stable. 

•  does  not  contain  any  factors  of  the  form  (1  -h  asi  +  6S2),  and  it  has  no  NSSK  s  at  (00, 00). 

•  a  and  di  >  0. 

•  N>K, 

The  presentation  of  the  result  requires  the  following  definitions: 

•  Define  the  1-D  degree  of  iV’(s,s)  as  a. 

•  Define  the  1-D  degree  of  D{s,  s)  as  /?. 


•  Define  Gr<,(5i.52)  as  the  Gr(si,S2)  with  the  highest  degree  difference: 


Nro  -  Kro  =  niax[^r  - 


Thus, 


where 


Kro 

JJ(1  +  aiSi  H-  biS2) 

JJ(1  +c,si  +  djSa) 
i=l 


ai  Ci 
bi~  di~ 


except  if  Kro  =  0,  in  which  case  the  numerator  expression  is  simply  equal  to  1.  (If  there  is  more  than 
one  such  Gr,  then  any  one  of  them  can  be  taken  to  be  Gro-) 


3  Main  Results 


Theorem  1  The  DBT  o/H(si,S2)  (1)  *s  BIBO  stable  if  and  only  if 


(a-l3)  +  {K-  Kro)  -{N-  Nro)  <  -1- 


(4) 


Proof:(SufBciency)  After  examining  bounds  on 

K 

JJ(1  +  a.si  +  bis^) 

«=i  _ 

N 

JJ(1  +  CjSi  +  diS2) 
«=1 


Jl-^00 


4a-*  00 
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and 


N{si,S2) 

D{si,S2) 

51- ^OO 

52—  ^00 

we  wUl  show  that  the  stated  condition  is  sufficient  for  BIBO  stability.  The  path  to  infinity  chosen  for  si  and 
S2  must  lie  in  A^.  This  corresponds  to  the  path  specified  by  Dautov  to  (2:1,22)  =  (-1,  -1)  in  the  discrete 

domain. 

Consider  the  expression: 

K  ^ 

T\{l+aiS,  +  biS2)  Y[{l  +  aiSi  +  biS2)  n  a  +  + 

_  *=1  _ j=Kro  +  l  _ ^ 

^  ~  Nro  ^ 

TT(1  +  C<5l  +  di52)  P[(l  +  C.-Sl  +diS2)  ]][  (1  +  CjSl  +  djS2) 

.^1  <=1  j=Nro+l 

where  because  of  how  we  defined  Groi 

Oj  Ci 
bi  ~  di 

The  choice  of  path  for  si  and  S2  must  coincide  with  the  requirements  for  the  application  of  Dautov’s 
criterion;  namely.  Re(si,S2)  >  0  and  (si,S2)  (00,00).  Depending  on  this  choice,  each  factor  in  Gro  will 

either  go  to  00  or  remain  bounded.  (Actually,  the  preceding  is  true  for  all  factors,  including  those  indexed  by 
j.)  The  difference  between  the  number  of  unbounded  factors  in  the  numerator  and  denominator  determines 
the  asymptotic  behavior  of  the  expression.  Without  loss  of  generality,  we  choose  the  path: 

si  =  <T  +  if2  (5) 

52  =  ro(<r  -  jQ) 

This  choice  causes  all  of  the  factors  in  Gro  (those  indexed  by  i)  to  approach  a  finite  value  for  >  0  as 
fi  -*•  00.  The  factors  indexed  by  j  will  go  to  00  in  the  limit.  Because  Gro  has  the  highest  degree  difference 
of  all  the  Gr,  the  path  given  by  (5)  results  in  the  slowest  convergence  of  iI(si,S2)  (or  fastest  divergence.) 
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Examining  the  asymptotic  behavior  of  the  expression  containing  factors  indexed  by  j  results  in  the 
observation  that  as  si  and  sj  approach  oo  by  the  chosen  path,  the  entire  expression  can  be  asymptotically 
bounded  from  above  by  Ci  •  Q.iK-Kro)-{N-Nro)^  where  Ci  is  a  finite  constant. 

Now  we  must  derive  an  expression  which  describes  the  asymptotic  behavior  of  as  si  and  S2 

approach  oo.  First,  note  that  because  this  expression  has  no  NSSK’s  at  (oo,  oo),  we  can  simplify  the  analysis 
by  studying  for  Q  -  oo.  If  the  degree  of  N{^,Q)  is  a  and  the  degree  of  D{Q,Q.)  is  then  the 

expression  behaves  asymptotically  as  C2  where  C<i  is  a  finite  constant. 

Combining  the  derived  bounds  as  a  product,  we  obtain  an  upper  bound  Bu  for  the  B'(si,S2)  given  by 

(1)  for  the  critical  path  in  (5): 

B„  =  C1C2  •  (®) 

If  condition  (4)  is  satisfied,  then  as  Q  -*  oo,  ir(si,S2)  -  0  independent  of  the  path  in  A-,  which  implies 
BIBO  stability  of  the  DBT  of  H{si,  S2). 

(Necessity)  For  this  part  of  the  proof,  we  will  show  that  for 

(a)  {a-l3)  +  iK-  Kro)  -{N-  Nro)  >  0 

(b)  {a-0)  +  {K-  Kro)  -  (^■  -  Nro)  =  0, 

we  will  not  obtain  a  unique  limit  of  H{si,S2)  at  (00,00). 

(a)  Recall  the  upper  bound  on  H{si,S2)  derived  as  (6); 

=  C1C2  • 


8 


Since  ^(51,52)  actually  grows  with  n(or-/?)+(iC-i<'ro)-(iV-Nro)^  we  can  formulate  a  lower  bound  as: 

Bi-D- 

Clearly,  if  the  exponent  of  Q  in  (6)  is  positive,  then  as  ►  00  along  the  path  in  (5),  -ff  (^i,  S2)  grows  without 
bound.  According  to  Dautov’s  criterion,  if  this  limit  does  not  exist,  the  transfer  function  is  unstable. 

(b)  Now  the  exponent  of  Q  is  zero,  and  if  (51,52)  is  bounded  as  f2  — ►  00.  It  is  trivial  to  show  that  in  this 
case,  the  bound  depends  on  the  path  taken;  i.e.,  the  limit  at  (00,00)  does  not  exist.  ^ 


Theorem  2  The  continuous  transfer  function: 


is  BIBO  stable  if 


•  for  each  Gr{si,  S2),  we  have  Kr  <  Nr,  and  Ci,di  >  0,  and 
.  is  BIBO  stable. 

D(3i,S2) 


Proof:  Since  we  know  that  the  cascade  of  BIBO  stable  transfer  functions  results  in  a  BIBO  stable  system, 
showing  that  each  of  the  Gr(si,S2)  is  stable  will  suffice  to  show  the  stability  of  i?(si,  S2). 


First,  we  rewrite  (3)  as; 


where 
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Note  that  each  of  the  factors  indexed  by  j  is  a  BIBO  stable  transfer  function  [13].  Therefore,  the  cascade  of 
the  {Nr  -  Kr)  BIBO  stable  transfer  functions  indexed  by  j  is  also  BIBO  stable. 

Rearranging  one  of  the  factors  indexed  by  i,  and  using  the  fact  that  ^  —  dj’  >  obtain. 

1  +  ajSi  +  6,S2  _  ^  ~  ^ 

1  +  CjSi  +  d,S2  Ci  [  1  +  CjSi  +  diS2  . 

Therefore,  each  of  the  transfer  functions  indexed  by  i  is  BIBO  stable,  and  we  can  infer  the  stability  of  the 
cascade  of  the  Kr  BIBO  stable  transfer  functions  indexed  by  i. 

Using  the  same  cascade  argument,  we  can  now  make  the  statement  that  because  each  Gr  consists  of  a 
cascade  of  BIBO  stable  transfer  functions,  each  Cr  can  be  said  to  be  BIBO  stable.  And  finally,  since  the 
product  of  the  Gr  is  a  BIBO  stable  transfer  function,  and  ^[77^  is  BIBO  stable,  then  fr(si,S2)  is  also 
stable.  ^ 

Corollary  1  The  double  bilinear  transformation  fails  to  'preserve  stability  when  a  continuous  transfer  func- 
iion  of  the  form  given  in  (7)  satisfies  Theorem  2  and: 

Nro  -  Kro  +  + 


Proof:  The  proof  follows  directly  from  Theorem  1.  If  a  BIBO  stable  continuous  transfer  function  satisfies 
the  above  condition,  then  it  fails  to  satisfy  (4).  ^ 

This  corollary  helps  us  to  identify  classes  of  systems  for  which  the  DBT  does  not  preserve  stability.  From 
Theorem  1,  the  inverse  DBT  of  a  BIBO  stable  discrete  transfer  function  must  satisfy: 

Nro  -  Kro  <  -1  +  (/?  -  a)  +  (iV  -  K), 
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It  is  possible  to  identify  some  special  cases  that  illustrate  the  instability  of  discrete  systems  obtained 
from  stable  continuous  transfer  functions  using  the  DBT.  First,  consider  an  fr(si,S2)  for  which  N{si,S2) 
and  D{si,S2)  have  the  same  degree,  and  for  which  in  each  Gr,{r^  ro).  Nr  =  Kr-  Another  class  of  systems 
addressed  by  Corollary  1  is  the  class  of  systems  which  consists  of  N{si,S2)/D(si,S2)  and  a  single  Gr-  As 
long  as  Kr  <  Nr  and  /?  >  a,  the  continuous  system  is  BIBO  stable.  For  both  classes  of  functions,  as  long  as 
fi  =  a,  the  DBT  fails  to  preserve  stability.  Summarizing  these  special  cases,  we  have: 

•Nr  =  Kr,  r  ^  To,  a  =  /?  =>•  {N  —  K)  =  {Nro  ~  Kro)  DBT  fails. 

•Nro  =  N,Kro  =  K^{N-K)  =  {Nro  -  Kro)  =>  0  <  -1  +  (i?  -  a)  ^  DBT  fails  when  (/?-«)  =  0. 

Note  that  for  the  above  special  cases,  the  transfer  function  can  stabilize  the  overall  transfer 

function  as  long  as  possesses  one  or  more  zeros  at  infinity;  i.e.,  (^  -  a)  >  0. 

Corollary  1  can  be  applied  to  the  example  given  by  Goodman  in  [11]: 


According  to  Theorem  2,  this  function  is  BIBO  stable,  but  according  to  Corollary  1,  its  DBT  is  unstable. 

The  DBT  of  the  inverse  of  a  BIBO  stable  member  of  the  class  of  systems  described  by  (1)  cannot  be 
BIBO  stable  because  the  limit  of  such  a  H{si,S2)  as  (si,  S2)  (00, 00)  is  zero.  This  makes  the  corresponding 

limit  of  its  inverse  nonexistent.  Thus  from  Dautov’s  criterion,  this  inverse  is  not  BIBO  stable. 

However,  by  adding  a  non-zero  constant  C  to  an  H{si,S2)  whose  DBT  is  BIBO  stable  we  obtain. 

H{si,S2)  =  C  +  H{sXyS2) 

The  DBT  of  this  modified  transfer  function  is  also  BIBO  stable.  In  particular,  examining  the  behavior  of 
the  system  at  the  NSSK  at  infinity,  the  limit  of  H(si,  S2)  exists  and  is  equal  to  C.  Furthermore,  its  inverse 
has  a  unique  limit  equal  to  1/C. 
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Note:  H{si ,  52)  can  be  written  as  follows: 

N  K 

C  *  52) JJ(1  +  CiSi  +  diS^)  ^N{s\,  52)p(l  +  +  ft* ^2) 

(si ,  S2)  =  - — - Jf - — - 

D{si ,  S2)  JJ(1  +  CiSi  +  diS2) 

1=1 

If  the  numerator  of  the  DBT  of  ^(51,52)  has  no  zeros  in  except  for  the  NSSK  at  (-1,  -1),  then  the 
DBT  of  ^(si ,  S2)  and  its  inverse  are  a  BIBO  stable  mutually  inverse  pair  of  2-D  discrete  transfer  functions. 
Existing  tests  for  zero  exclusion  from  17  may  be  used  to  check  the  numerator  of  the  DBT  of  H{si,  S2). 

4  Conclusion 

In  this  paper,  we  have  examined  the  BIBO  stability  of  a  class  of  2-D  continuous  transfer  functions  and  the 
stability  of  its  discrete  equivalent  using  the  double  bilinear  transformation.  The  condition  given  in  Theorem 
1  allows  the  surprising  result  that  the  cascade  of  two  or  more  BIBO  unstable  discrete  transfer  functions  may 
actually  be  stable.  For  example,  consider 

H2{si,S2)  —  ^  j  ^  ^  <1152}  (1  +  C2S1  -I-  d2S^  ’ 

where  ^  ^  The  DBT  of  Ff2(si,S2)  is  stable  according  to  Theorem  1,  although  the  DBT  of  each  factor 
of  H2{si,S2)  is  unstable.  Comparing  the  sufficient  condition  for  stability  of  the  continuous  system  with  the 
necessary  and  sufficient  condition  for  stability  of  its  DBT  reveals  the  conditions  under  which,  for  the  class 
of  systems  considered,  the  DBT  fails  to  preserve  stability. 

We  have  also  shown  that  it  is  possible  to  generate  BIBO  stable  mutually  inverse  transfer  functions  from 
the  class  of  2-D  continuous  transfer  functions  under  consideration. 
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ABSTRACT 

This  paper  addresses  the  asymptotic  stability  of  linear 
shift-variant  difference  equations  whose  coefficients  are 
uncertain  in  an  m-dimensional  hyperdiamond.  The  ap¬ 
proach  used  here  allows  the  construction  of  regions  in  the 
coefficient  space  guaranteeing  asymptotic  stability  that 
extend  beyond  the  region  specified  by  existing  results. 

I.  Introduction 

The  pioneering  work  of  Kharitonov  [1]  concerning  the  Hur- 
witz  stability  of  interval  polynomials  has  generated  con¬ 
siderable  interest  in  finding  ways  to  apply  these  results 
to  representations  of  discrete  time  systems.  The  results 
described  in  [2—6]  address  the  Schur  stability  of  interval 
polynomials,  which  may  be  used  to  represent  linear  shift- 
invariant  discrete  time  systems.  The  authors  of  [7]  con¬ 
sider  the  Hurwitz  stability  of  polynomials  with  the  coeffi¬ 
cients  in  a  diamond.  Among  the  reasons  given  for  exam¬ 
ining  the  diamond-shaped  uncertainty  structure  (for  both 
continuous  and  discrete  systems)  are  the  restrictiveness 
of  independent  coefficient  variations  and  the  possibility  of 
generalizing  results  for  the  hyperdiamond  to  wider  classes 
of  regions.  Other  results  obtained  using  a  diamond-shaped 
uncertainty  structure  include  those  found  in  [8-11]. 

In  the  case  of  linear  difference  equations  with,  shift- 
variant  uncertadn  coefficients,  we  cannot  generally  rely 
on  the  frequency  domain  techniques  which  wotk  for  time- 
invariant  systems.  Here,  the  Schur  stability  of  an  interval 
polynomial  or  matrix  does  not  guarantee  the  stability  of 
a  time- variant  system  whose  parameters  are  constrained 
by  the  interval  system.  Some  recent  results  on  the  robust 
stability  of  discrete  time-variant  systems  can  be  found  in 
[12-16].  Most  of  these  results  use  state  space  representa¬ 
tions  to  describe  the  system. 
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In  [15],  the  authors  examine  linear  shift- variant  dif¬ 
ference  equations  whose  uncertain  coefficients  are  con¬ 
strained  to  lie  in  a  hyperdiamond  that  is  symmetric  with 
respect  to  the  origin  in  the  coefficient  space.  They  show 
that  the  unit  hyperdiamond  is  the  largest  such  region  sym¬ 
metric  with  respect  to  the  origin  that  guarantees  asymp¬ 
totic  stability.  By  reformulating  the  difference  equation 
as  a  Schur  stable  nominal  polynomial  driven  by  coefficient 
perturbations  about  the  nominal  coeffcients  (rather  than 
with  respect  to  the  origin),  we  will  generalize  the  results 
in  [15]. 

II.  Problem  Formulation 

Consider  the  m-th  order  difference  equation  with  shift- 
variant  uncertain  coefficients: 

y(n)  =  ai(n)i/(n  —  1)  -i - 1-  am(n)y(n  —  m),  (1) 

where  ai{n)  =  +  Aaj(n).  This  equation  may  also  be 

written  as: 

y(n)  =  a°y(n  -  1)  4*  •  •  •  -h  -  m)  -h  e(n  -  1),  (2) 

where 

c(n  -  1)  =  Aai(n)y(n  -  1)  -h  •  •  •  -h  Aam(n)y(n  -  m).  (3) 
The  uncertain  Aai(u)  vary  inside  the  hyperdiamond: 

f;|Aai(n)|  =  S  (4) 

issl 

The  nominal  coefficients  a®  are  chosen  such  that  the  co¬ 
efficient  vector  (u? ,  •  *  * ,  ^m)  describes  a  Schur  polynomial. 
If  we  define  h{n)  to  be  the  impulse  response  of  (2),  then 
define  7,  a  positive  real  number,  as  follows: 


f:iA(n)|’ 


n=:0 


This  work  wm  supported  in  part  by  funds  from  the  Office  of 
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III.  Main  Result 

Theorem  1  The  shift-variant  system  described  by  (2), 
(3),  and  (4)is  asymptotically  stable  if 

5  <  7  (6) 


Proof: 

The  system  output  y(n)  may  be  expressed  as  the  sum  of 
two  response  components:  the  response  due  to  arbitrary 
initial  conditions,  y/(u),  and  the  response  due  to  the  in¬ 
put,  y«(n).  Thus,  (2)  can  be  expressed  as: 

y(7i)  =y/(n)  +  ye(n). 

Suppose  we  know  that  for  n  <  Nq,  ly(n)|  <  By^\  We  want 
to  show  that  with  increasing  n,  we  can  obt2un  successively 
smaller  bounds  on  the  output  |y(n)|;  i.e., 


ll/(n)l 

< 

Bi^\ 

Vn>  0 

|2/(«)I 

< 

<  Bi°\ 

Vn  >  Na 

|y(«)l 

< 

p(0  ^ 

£?y  ^  JDy  , 

Vn  >  Ni-i 

so  that  ►  0  as  1  ^  oo,  and  thus,  |y(n)|  0  as 

n  — ^  oo. 

Step  L  Derive  the  following  upper  bound  on  |e(n  -  1)|: 

le(n  —  1)1  =  lAai(n)y(n  —  1)  -I - h  Aa,n(^)y(^^  -  ^)l* 

Since  for  n  <  iVo,  we  know  that  |y(n)l  <  we  can 

write: 

\e{n  -  1)1  <  (lAai(n)l  +  •  •  •  +  |Aa„(n)l)5W 
|e(n-l)l  tx<IVq  +  1 

=  n<No  +  l  (7) 


Step  2.  We  obtain  a  bound  for  \y(NQ  +  1)|  using  BIBO 
property  to  find  a  bound  on  the  forced  response: 


iVo+l 

\ye(No  +  l)\  =  \'£h{k)e{No-k) 
ib=0 

\y.iNo  +  l)\<Bi^^-f^\h{k)\ 


(8) 


4=0 


Using  (7)  for  in  (8),  we  obtain  the  following  upper 
bound  for  lye(Wo  +  l)h 


4=0 


Note  that  because  our  choice  of  nominal  coeflScients  de¬ 
scribes  a  Schur  polynomial,  the  portion  of  the  response 
due  to  initial  conditions  approaches  zero  asymptotically 
as  n  approaches  infinity.  More  precisely,  given  e/  >  0, 
there  exists  Nq  >  0  such  that  for  n  >  Wo, 


lyWl  <  + 


(10) 


We  use  this  fact  to  write  the  bound  on  the  total  response, 

\y(No  + 1)|: 

=  +  (11) 


Step  5.  Show  that  <  5y^^ 
Substituting  (9)  for  flyi^  in  (11),  we  have: 


4=0 

Now  we  solve  the  following  inequality  for  S : 

+  (12) 


4=0 


This  provides  a  condition  for  which  we  attain  a  reduction 
in  bound: 


5< 


1 


oo  » 


(13) 


^lh(k)l  B(°^'^lh(k)l 


4=0 


4=0 


Now  since  we  know  from  (6)  that  5  <  7,  we  may  write: 

5  =  7- /i,  0</i<7  (l^l) 

Using  (5),  we  may  rewrite  (13)  as: 


5<7’ 


e/ 


4=0 


(15) 


and  we  can  obtain  a  reduced  bound,  since  given  /x,  we  can 
always  find  a  sufficiently  small  €/  such  that 


(16) 


BrEi^(h)i 


or 


4=0 


7  ^ 


Step  4^  Show  that  this  reduced  bound  By^^  is  valid  for  all 
n  >  Wo  +  1. 

Consider  n  =  Wi  -h  2.  Using  the  procedure  of  Step  1,  we 


(9) 


gAn  write: 

|e(iVo  +  1)1  <  5  •  max{ly(iVo  +  1)|,  •  •  • .  |y(^o  +  2  -  m)|} 
KiVo  +  l)|<5fl(°>  (IT) 

|e(iVo  +  1)1  has  the  same  bound  as  |e(^o)|,  so  the  BIBO 
property  tells  us  that  the  bound  on  |y(iVo+2)|  is  the  same 

as  on  Iy(iVo  +  1)|;  i.e., 

If  we  consider  any  n  >  +  1,  we  have: 

|c(n  -  1)1  <  5  •  ^ma^{|y(n  -  i)|} 

Since  all  of  the  |y(n  —  i)|  are  bounded  by  either  By  ^  or 
By^\  we  have: 

|c(n  -  1)1  <  S  •  B^°\  n  >  IVo  +  1.  (18) 

and  therefore,  we  obtain: 

|y(")l  <  71  >  iVo  + 1,  (19) 

Note  that  since  B^^  <  By°\  we  have  (for  n>  No  +  1): 

|y('i)i  <  =  aBl°\  a<l,  (20) 


We  have  now  a  new  bound  on  |e(7i  — 1)|  that  is  vahd  &om 
the  time  we  consider  the  restarting  of  the  system,  up  to 
and  including  n  =  iVi  +  1: 

=  (22) 

Step  7.  We  may  again  use  the  BIBO  property  to  find  a 
bound  on  |y(JVi  +  1)|. 

iye(i^i+i)i  <  E  \f'ik)\m-k)\ 

//i-iVo-m  00 

i=0  k=0 

BiV  =  ■Y\h{k)\  (23) 

fc=0 

Using  (22)  for  Bi^^  in  (23),  we  obtain: 

B^l>  =  B^;^-S-Y\hm  (24) 

*=0 

To  obtain  a  bound  on  the  total  response,  we  write: 


Step  5.  Because  we  model  the  system  as  a  shift-variant 
nominal  system  with  a  time- variant  driving  input,  we  can 
examine  the  system  response  starting  from  any  time  in¬ 
stant.  Here,  we  examine  the  response  as  if  the  system 
“started”  at  n  =  iVo  +  m  -I-  1.  Note  that  in  this  case,  the 
system  has  non-zero  initial  conditions  bounded  by 

We  may  again  view  the  system  response  as  comprised  of 
two  parts: 

y(^)  =  y/(7i)  +  ye(n) 

We  again  wait  long  enough  for  lj^/(n)|  to  become  suffi¬ 
ciently  small.  Or,  given  e/  >  0,  there  exists  Ni  >  0  such 
that  for  n>  Niy  jy/(u)|  <  c/,  or 

|y('*)l  <  |ye(”)l  + «/  (21) 

Step  6.  Find  new  bound  on  |e(7i  —  1)|  for  Nq  +  m  +  1  < 
n<  Ni  +  l;  i.e.: 

|e(n  —  1)1  =  lAai(n)y(n  —  1)  H - i-  Aam(n)y(u  -  >7»)1- 

Note  that  for  iVo  +  tti  +  1  <  n  <  Wi  +  1,  we  know  that 

{|y('»  -  01}  < 

l<»<m 

and 

|c(n  -  1)1  <  S  •  jVo  +  m+  l<n<iNri  +  l 


Bl^^  =  B^J+ei,  (25) 

since  |y/(7i)|  <  £/  for  n>  Ni- 

Step  8.  Using  the  same  argument  as  in  Step  3,  we  can 
show  that  or  that  we  can  write 

Sf  >  =  a  ■  B<^\  (26) 

And  as  in  Step  4,  is  a  valid  bound  on  |y(n)|  for  all 
n  >  Ni  +  1. 

Step  9.  Note  that  by  the  appropriate  choice  of  the  £/  in 
(10)  and  in  (21),  we  can  write: 

=  a  =  0  <  a  <  1. 

Step  10.  By  induction,  using  Steps  5-8  repeatedly,  we  find 
that  B^^  =  a‘  •  B^y^  is  a  valid  bound  on  ly(7i)l  that  can 
be  constructed  for  the  system  for  n>  Ni-i- 
Clearly,  as  t  —  oo,  —  0.  Thus,  as  n  -*  oo,  |y(n)|  —  0. 

IV.  Examples 

Example  1.  In  (2),  let  a?  =  0,  i  =  l,...,m.  Since 
h(n)  =  5(n)  for  such  a  system,  7  =  1,  and  we  have  the 
unit  hyperdiamond  of  [15]  as  the  region  which  guarantees 
asymptotic  stability. 


Example  2.  Consider  a  second  order  nominal  system 
whose  characteristic  equation  has  real  or  imaginary  roots. 
It  be  shown  that  7  is  equal  to  the  size  of  the  largest 
diamond  centered  at  (nj ,  that  fits  inside  the  triangular 
region  of  Schur  stability.  If  the  characteristic  equation  of 
the  nominal  system  has  complex  roots,  the  value  of  7  may 
be  slightly  less  than  the  size  of  the  largest  diamond  that 
fits  in  the  triangle. 

V.  Conclusion 

By  using  a  nominal  Schur  stable  system  driven  by  pertur¬ 
bations  to  model  an  uncertain  shift-variaint  discrete  sys¬ 
tem,  we  have  established  a  new  method  for  the  construc¬ 
tion  of  diamond  shaped  uncertainties  around  the  nomi- 
anal  system  which  preserve  stability  of  the  resulting  shift- 
variant  system.  The  condition  derived  here  is  sufficient 
for  asymptotic  stability  of  the  class  of  systems  considered, 
and  we  expect  that  further  work  will  show  that  the  con¬ 
dition  is  also  necessary  for  stability;  that  is,  that  the  size 
of  the  hyperdiamond  describing  the  perturbations  about 
the  nominal  coefficient  vector  must  not  exceed  the  size 
specified  by  Theorem  1.  Two  observations  support  this 
prediction:  (a)  when  we  allow  the  nominal  coefficient  vec¬ 
tor  to  be  the  origin,  we  obtain  the  same  result  as  in  [15], 
2uid  (b)  in  some  cases  the  hyperdiamond  of  the  result  pre¬ 
sented  here  extends  to  the  boundary  of  the  region  of  Schur 
stability. 
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Robust  Asymptotic  Stability  of  2-D  Shift-Variant 
Discrete  State-Space  Systems 

S.  A.  Yost  and  P.  H.  Bauer 


Abstract 

The  results  described  in  this  paper  provide  conditions  for  the  asymptotic  stability  of  2-D  shift- 
variant  uncertain  systems  expressed  using  the  Roesser  state-space  description.  A  necessary  and 
sufficient  condition  for  the  asymptotic  stability  of  1-D  systems  involves  checking  all  products  of 
extreme  matrices.  The  same  test  is  shown  to  apply  to  2-D  systems,  although  the  corresponding 
stability  condition  is  sufficient,  but  not  necessary. 

1  Introduction 

The  problem  of  the  stability  of  discrete  interval  matrix  systems  has  sparked  considerable 
interest  in  recent  years.  Many  of  the  early  results  in  this  area  focused  on  linear  shift-invariant 

systems  [1,2].  Because  many  discrete  systems  exhibit  quantization  and  other  nonlinearities, 
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some  of  the  effort  concentrated  on  the  study  of  linear  shift- variant  systems,  which  may  be 
used  to  model  some  nonlinear  systems  [3-9]. 

The  shift-variant  problem  requires  an  approach  quite  different  from  those  used  m  the 
shift-invariant  case.  The  Schur  stability  of  a  family  of  shift-invariant  matrices  does  not 
necessarily  imply  the  stability  of  a  shift-variant  counterpart.  Until  recently,  the  results 
obtained  for  shift- variant  systems  were  either  conservative  sufficient  conditions  or  necessary 
and  sufficient  conditions  that  applied  only  to  system  matrices  of  very  particular  structures. 

In  this  paper,  we  will  show  that  recent  results  addressing  the  robust  stability  of  1-D 
discrete  shift-variant  systems  [9]  can  be  extended  to  the  2-D  case.  The  following  section 
introduces  the  necessary  notation  and  the  problem  formulation.  Section  3  gives  the  main 
result;  i.e.,  it  shows  how  an  important  necessary  and  sufficient  condition  for  the  stability 
of  1-D  shift-variant  discrete  systems  can  be  adapted  for  the  2-D  case  as  a  slightly  more 
conservative  sufficient  condition. 
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2  Notation  and  Problem  Formulation 


In  this  paper,  we  consider  2-D  shift-variant  uncertain  systems  described  using  the  Roesser 


state-space  representation: 

x*(ni  +  1,712) 

x”(T^l,7^2  +  1) 


=  A{ni,n2)x{ni,n2) 


(1) 


AHv{ni,n2)  x^{ni,n2) 

AvH{ni,n2)  Avv{ni,n2)  x*'(ni,n2) 

where  x{ni,n2)  €  is  the  state  vector  in  a  2-D  system  of  order  H  in  ui,  and  V  in  122. 

This  vector  may  also  be  written  as: 


x{ni,n2)  = 


^'‘(711,772) 

x”(7Zi,7l2) 


A{ni,n2)  is  the  uncertain  system  matrix  for  a  shift-variant  2-D  system,  with  A/fff(77i,7i2)  € 
AHy{nun2)  €  ,  AvH{nun2)  G  and  Avv{nun2)  G  Note  that 

we  can  describe  the  uncertainty  structure  of  the  2-D  system  as  ^(711,712)  G  A^,  where 
G  is  the  interval  matrix  which  describes  the  set  of  matrices 

A'  =  {A  G  :  A  =  Ao  +  E  A,(7ii,772)Aj,  (2) 

»=1 

where  Ai(7ii,  712)  G  [A^,  Ai],  z  =  1,  •  •  •  ,p;  Ao,  Ai  G  and  p  is  any  positive  integer. 
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The  results  described  in  this  paper  require  the  following  additional  notation: 

•  The  decomposition  of  A{ni,n2)  defined  as  follows: 

n  ^  _\  AHH{ni,n2)  Affy(ni,n2)  1  K{n-,  no)  =  ^ 

/(ni,n2)  -  Q  Q  I  1)  2j  [  Av'i/(rai,n2)  Avv{ni,n2)  _ 

•  The  variable  dimension  supermatrix  defined  as  follows: 

■  J(n,0)  0  •••  o' 

/^(n,0)  J(n-l,l)  •••  0 

/!„(")=  ;  ;  i  (3) 

0  0  •••  J(0,n) 

0  0  •••  /ir(0,n)  _ 

Note  that  Acc(n)  €  3i(n+2)(i/+v)x(n+i)(H+v), 

•  Let  Ai(n)  be  the  Ai(ni,  712)  in  (2)  corresponding  to  A^{n)  along  the  diagonal  n  =  ni+n2. 
Note  that  because  Acc{f^)  has  (n  + 1)  x  [H  +  V)  columns,  there  are  (ra  +  l)p  such  A,(ra). 


•  Let  Af^^^  =  Accin)  with  A,(n)  =  Aj  or  Aj. 

•  Let  A^(n)  be  the  set  of  all  extreme  Acc(>2):  A^(ra)  =  i  =  1,  •  •  • ,  2^"'*’ 


•  Let  be  the  set  of  all  length  k  products  of  extreme  matrices: 

=  {Pk%(h-U-  ■  ■ .  io)  =  -  2)  •  •  •  /I?  „(0)  : 

We  wish  to  derive  conditions  concerning  the  asymptotic  stability  of  the  2-D  shift- variant 
system  (1),  with  structured  uncertainties  as  described  in  (2).  We  will  extend  the  1-D  results 
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found  in  [9]  to  the  2-D  case.  We  use  the  following  definition  for  the  asymptotic  stability  of 
a  multidimensional  system  [10]: 

Definition  1  A  m-D  first  hyperquadrant  causal  digital  filter  is  said  to  be  asymptotically 
stable  under  all  finitely  extended  bounded  input  signals  e(ni,  •  •  •  ,nm)  where 

le(ni,---,nm)|  <  M  for  ni -\ - hnm<  D 

e{ni,  •  •  • ,  Um)  =  0  for  ni  +  •  ■  ■  +  Um  >  D 

>  0,  1/  = 

and  M  being  a  real  bounded  number,  D  being  some  positive  integer,  if  all  the  outputs  of  the 
m-D  digital  filter  asymptotically  reach  zero  for  (ni  +  •  •  •  +  Um)  —*  oo,  n  G  .  (Note: 
is  the  first  m-D  hyper  quadrant.) 

This  definition  is  less  restrictive  than  definitions  which  assume  zero  input  and  finite  initial 
conditions  on  the  boundary  of  the  first  hyperquadrant.  Here  we  may  allow  finitely  extended 
bounded  input  signals  to  drive  the  system.  Eventually  the  system  will  operate  under  zero- 
input  conditions  for  (ni  -f  •  •  •  -t-  n,n)  large  enough.  We  need  this  less  restrictive  definition  to 
guarantee  the  generation  of  system  initializations  which  cannot  be  reached  using  only  initial 
conditions  on  the  boundary  of  the  first  hyper  quadrant. 

The  main  result  of  this  paper  was  proposed  in  a  previous  article  [11],  but  it  lacks  a  formal 
proof.  The  main  contribution  this  paper  makes  is  a  rigorous  proof  of  a  theorem  that  allows 
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for  a  finite  stability  test.  When  we  state  the  2-D  result  of  [11]  in  Theorem  1,  we  use  a 
slightly  different  notation  to  conform  to  the  subsequent  proof.  The  appeal  of  a  necessary 
and  sufficient  stability  criterion  that  can  be  implemented  as  a  finite  test  motivates  this  work. 


3  Main  Result 

Theorem  1  The  2-D  system  in  (1)  is  asymptotically  stable  in  the  sense  of  Definition  1  if 
there  exists  a  finite  k  such  that: 


B  ,■  ^  OS  ^  7  <  1 


(4) 


Proof:  Define  the  1-D  vector  as  follows: 

iin)  =  [x^(n,0f  ,x"(n,0f,/(n-  l,lf,---,/(0,nr,^’'(0,«rf  (5) 

This  vector  contains  the  values  of  all  of  the  state  variables  along  the  diagonal  ni  +  n2  =  n. 
K  (f>{n)  0  as  n  oo,  then  we  have  asymptotic  stability. 

To  study  the  asymptotic  behavior  of  ^(n),  we  write: 

^(n  +  1)  =  Acc{n)4{n), 
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where  Acc{n)  is  as  shown  in  (3).  We  may  also  write: 


<i>{n  +  1)  =  Acc{n)Accin  -  1)  •  •  •  Acc{n  -  k)^{n  -  fc), 


or  in  particular: 


4>{n  +  1)  =  Acc{n)A,,{n  -!)•••  Acc{0)£{0). 


Thus,  we  can  write  (f>{n  +  1)  as  follows: 


^(n+1)  = 


J(ra,0)  0 

A'(n,0) 


0 

0 


/(n-1,0) 

ii:(n-l,0) 


0 


A(0,n-  1) 


/(0,0) 

ii:(0,0) 


^(0) 


0  0  •••  J(0,n) 

0  0  •••  A(0,n) 

To  prove  that  the  meiximum  1-norm  of  the  product  matrix  occurs  for  one  of  the  extreme 

product  matrices,  we  must  show  that  each  entry  in  the  product  matrix  is  a  multilinear 

function  of  the  Aj(n).  Consider  the  form  of  Acdp-)-. 


AcciP'')  — 


J(n,0)  0 

i£'(n,0)  J(n-l,l) 


0 

0 

J(0,  n) 
K{Q,n) 


Note  the  location  in  the  spatial  plane  of  each  entry  of  Acc{n).  Each  J(ni,n2)  and  K{ni,n2) 
lies  on  the  diagonal  711  +  772  =  ti.  Now  consider  Ace{'n'  —  !)•  For  this  supermatrix,  each 
J(77i,  712)  and  K{ni,n2)  lies  on  the  diagonal  tii  +  773  =  77  -  1.  Thus,  an  entirely  different  set 
of  points  in  the  spatial  plane  corresponds  to  the  entries  in  Acc{n  -  1).  Now  when  we  form 
the  product  Acc{n)Accin  -  1),  we  obtain: 


J(n,0)J(n-  1,0) 

0 

K(n,0)  J(n  -  1,0)  +  J(n  -  1,  l)K{n  -  1,0) 

0 

A:(n-  l,l)A'(n-l,0) 

0 

0 

0 

0 

0 

0 

J(l,n-l)J(0,n-l) 

0 

...  A:(l,n  -  l)J(0,n  -  1)  -h  J(0,n)A:(0,n  -  1) 

0 

A'(0,n)A:(0,7i-l) 

Note  that  each  entry  in  this  product  matrix  is  multilinear  in  the  uncertain  parameters  of 
the  2-D  system.  Continuing  to  right  multiply  by  Acc{n  —  2)  and  so  on,  we  see  that  we  are 
introducing  parameters  at  points  in  the  spatial  plane  distinct  from  those  already  part  of  the 
product,  so  the  multilinearity  of  entries  in  the  product  matrix  Acc{n)Acc{'n  —  !)•••  A^dn  —  k) 
is  preserved.  This  multilinearity  of  entries  allows  the  assertion  that  the  maximum  1-norm 
occurs  at  one  of  the  extreme  product  matrices. 

Note  also  that  if  we  consider: 

£{M  +  m  +  1)  =  Acc{M  +  777)  •  ■  •  Acc{M)^{M) 
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^(m  +  1)  =  Accim)  •  •  •  i4cc(0)^(0), 


ajid 

then 

max  ||>lcc(-^  +  m)  •  •  •  Acc{M)\\i  =  max  '^Acdpi)  ■  •  •  i4cc(0)|li, 

Ai(n),n=M,—,iV/+m  Aj(n),n— 0,— ,m 

since  each  column  of  the  product  matrix  has  the  same  form.  Because  this  maximum  1-norm  is 
independent  of  M,  we  can  let  M  =  0  without  loss  of  generality.  In  general,  Acc(ni)-^cc(^  ~  1) 
has  mx{H+V)  columns,  each  of  which  has  the  same  form,  independent  of  m.  We  can  extend 
this  argument  to  a  longer  product  of  supermatrices,  Acc{pi)Acc{p^  ~  l)-^cc(^  ~  2).  Here,  the 
form  of  the  columns  changes,  but  again,  each  column  has  the  same  form,  independent  of  m. 
Thus,  max||Acc(m)Aco(m  -  l)Acc(m  -  2)||i  will  be  the  same  as  max||Acc(2)Acc(l)Acc(0)||i 
for  any  integer  m  >  2.  Because  the  norm  is  independent  of  m,  finding  a  finite  k  for  which 
max  \\Pkcci^k-i,  •  •  • ,  *o)lii  <  7  <  1  suffices  to  verify  the  stability  of  (1).  □ 

Remarks: 

•  The  formulation  of  this  2-D  result  allows  the  application  of  the  computer-aided  test 
described  in  [9]  to  2-D  shift- variant  systems. 

•  The  algorithm  for  the  1-D  case  allows  the  use  of  essentially  any  induced  matrix  norm. 
When  implemented  for  2-D  systems,  the  algorithm  uses  only  the  1-norm.  The  oo-norm 
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ca>iinot  be  used,  since  the  rows  of  the  product  matrix  do  not  have  the  same  form,  and 
thus  in  general, 

max  \\Acc{M  +  m)  •  •  •  Acc{M)\\co  ^  max  |lAcc(m)  •  •  •  Acc(0)||^. 

•  Unlike  for  the  1-D  case,  max  \\Pk,cc{^k-i,  *  •  • ,  *o)lli  <  7  <  1  is  not  necessary 

for  asymptotic  stability,  but  it  is  not  believed  that  this  condition  is  very  conservative. 
Recall  that 

^(n  +  1)  =  (n  ^(^)- 

\jt=o  / 

Since  as  n  oo,  the  length  of  ^  grows  without  bound,  each  component  of  ^  may  ap¬ 
proach  0  without  the  sum  of  such  components  approaching  0.  So  ||^(n)|li  ->■  0  is  suffi¬ 
cient,  but  not  necessary  for  stability,  and  thus,  max  — 

7  <  1  is  also  sufficient  but  not  necessary. 

4  Conclusion 

In  this  paper,  we  have  presented  a  rigorous  proof  of  a  theorem  which  gives  a  sufficient 
condition  for  the  asymptotic  stability  of  2-D  linear,  shift-variant  discrete  systems.  This 
theorem  extends  previous  results  for  1-D  systems,  and  it  allows  the  implementation  of  an 
algorithm  that  will  converge  in  a  finite  number  of  steps  for  almost  any  stable  2-D  system.  For 
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2-D  systems,  the  computational  complexity  of  the  test  is  much  higher  than  for  1-D  systems. 
The  results  can  be  generalized  to  the  m-D  case,  but  the  computational  complexity  increases 
even  more  than  for  the  2-D  case. 

The  condition  in  the  theorem  is  not  necessary  for  the  asymptotic  stability  of  2-D  systems, 
but  it  is  not  believed  that  this  condition  is  very  conservative.  Work  to  find  a  necessary  and 
sufi&cient  condition  for  instability  is  underway,  since  the  theorem  does  not  allow  for  the 
conclusion  that  a  system  is  unstable. 
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Robust  Stability  of  Multidimensional  Difference 
Equations  with  Shift-Variant  Coefficients 

S.A.  YOST  AND  P.H.  BAUER 

Department  of  Electrical  Engineering,  University  of  Notre  Dame,  Notre  Dame,  IN  46556-5637 


Abstract.  This  paper  addresses  the  asymptotic  stability  of  multidimensional  systems  represented  by  first  hyper¬ 
quadrant  causal  linear  difference  equations  whose  coefficients  are  shift-varying.  The  results  extend  previous  1-D 
results,  and  include  the  derivation  of  a  fixed  region  of  stability  in  the  parameter  space,  as  well  as  a  sequence 
of  shift-variant  parameter  regions.  In  the  case  of  a  fixed  parameter  region,  the  largest  stable  hyperdiamond  centered 
at  the  origin  will  be  obtained.  For  the  shift-variant  case,  it  will  be  shown  that  the  instantaneous  stable  parameter 
region  always  includes  this  hyperdiamond. 

Key  Words:  m-D  stability,  robustness,  shift-variant  systems,  structured  uncertainties,  asymptotic  stability 


1.  Introduction 

Most  of  the  recent  results  on  the  problem  of  robust  stability  of  discrete  systems  apply  to 
shift-invariant  systems.  A  one-dimensional  (1-D)  difference  equation  that  characterizes  a 
shift-invariant  discrete  system  is  stable  if  and  only  if  the  corresponding  polynomial  in  z 
has  none  of  its  zeros  in  the  closed  unit  disk.  Here,  the  z-transform  is  defined  with  respect 
to  positive  powers  of  z.  For  the  m-D  case,  the  polynomial  in  Zi,  . . . ,  z^  is  stable  if  there 
are  no  zeros  in  the  closed  unit  polydisk,  except  possibly  at  a  finite  number  of  locations 
on  the  distinguished  boundary  of  the  unit  polydisk  [1]. 

The  problem  of  robust  stability  under  structured  uncertainties  has  recently  been  addressed 
for  the  one-dimensional  discrete-time  case  [2] -[6].  Unfortunately,  the  results  obtained  for 
time-invariant  discrete-time  polynomials  are  much  more  complicated  than  their  continuous¬ 
time  counterparts  [7] ,  since  no  simple  vertex  results  are  possible.  Very  recently,  the  prob¬ 
lem  of  time-variant  discrete-time  systems  was  addressed  in  [8] ,  [9] .  Necessary  and  suffi¬ 
cient  conditions  for  stability  were  derived  for  polytopic  uncertainties  in  discrete-time  state- 
space  models  [9].  These  results  also  apply  to  time-variant  interval  polynomials.  The  work 
in  [8]  considers  the  problem  of  finding  the  largest  parameter  region  containing  the  origin 
which  ensures  global  asymptotic  stability  of  the  time-variant  system.  Other  recent  results 
on  the  stability  of  time-variant  state  matrices  can  be  found  in  [10],  [11]. 

Unfortunately,  very  little  is  known  about  robust  stability  of  shift-invariant  or  shift-variant 
m-D  systems  with  structured  uncertainties.  For  the  2-D  case,  a  TD  stability  robustness 
result  was  used  in  [12]  to  develop  a  stability  test  for  2-D  shift-invariant  state-space  systems. 
Some  other  results,  which  can  be  considered  an  extension  of  the  1-D  case  addressed  in 
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[13],  can  be  found  in  [14]-[16].  Because  these  results  allow  only  hypercuboidal  types  of 
uncertainties,  they  often  lead  to  conservative  sufficient  conditions  which  are  necessary  only 
for  special  cases. 

This  paper  attempts  to  reduce  the  conservativeness  in  the  work  of  [13]~[16]  by  following 
an  approach  introduced  for  1-D  systems  in  [8] ,  [9] .  This  leads  to  larger  stable  regions  in 
the  coefficient  space.  In  particular,  we  show  the  existence  of  a  fixed  hyperdiamond  in  the 
coefficient  space  which  guarantees  global  asymptotic  stability  of  a  shift-varying  polynomial. 
Furthermore,  the  region  constructed  will  be  shown  to  be  the  largest  such  region  to  guarantee 
stability.  Finally,  the  existence  of  a  shift-variant  region  of  stability  with  infinite  volume 
in  the  parameter  space  will  be  shown.  Obviously,  the  results  obtained  for  the  shift-variant 
case  can  also  be  used  as  sufficient  conditions  for  the  shift-invariant  case.  In  some  cases, 
the  parameter  regions  for  the  shift-variant  and  shift-invariant  cases  are  shown  to  be  identical. 


2.  Notation  and  problem  formulation 

We  require  some  definitions  and  notation. 


q 

9lo 

n,  i 

y{n) 

ai{n) 


a{n) 

Q. 

(^(n) 

B 

£1 

7 


shift  operation  {z  in  the  shift-invariant  case) 

set  of  nonnegative  integers 

first  m-D  hyperquadrant 

spatial  vectors  (n  i ,  .  .  . ,  and  (/  ^ ,  .  . . , 

output  of  the  m-D  system 

shift-varying  coefficient  of  a  shifted  output  in  a  m-D  difference  equa¬ 
tion  (for  example,  in  a  2-D  difference  equation,  a(3  2)(«i,  ^2)  is  the 
coefficient  of  y(ni  ~  3,  n2  ~  2)) 

ordered  vector  of  the  coefficients  of  a  m-D  difference  equation 

m  order  of  the  m-D  system  in  the  rij  direction 

fixed  region  in  the  coefficient  space  that  guarantees  asymptotic  stability 

sequence  of  regions  in  the  coefficient  space  that  guarantees  asymp¬ 
totic  stability 

{n  :  ni,  +  •  •  •  +  =  K},  ni,  . . . ,  /iT  €  9lo 

{n'.rii  +•••+«,„  <  K} 

max{iy(«)|} 

{(('i,  .  .  :0  <  ij  <  Nj,  j  =  1,  . .  .,m,  and  (/,,  . . . ,  ij  0} 

fixed  real  number  such  that  0  <  7  <  1 
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To  formulate  the  problem,  we  consider  the  following  class  of  w-D  first  hyperquadrant 
causal  linear  difference  equations  with  shift-variant  coefficients: 

>'(«)  =  “  D’  (1) 

where  the  uncertainty  structure  is  described  as  follows: 


X;  \ai(n)\  <7  Vn  6  aig-.  (2) 

Note  that  the  representation  in  (1)  corresponds  to  the  following  shift  operator  polynomial: 

P(qi,  =  ai(n)qi' •  •  •  qi”,  (3) 

where  qi  is  the  shift  operator  in  the  direction.  To  guarantee  the  asymptotic  stability  of 
the  system  described  by  (1),  it  is  necessary  to  show  that  the  output  approaches  zero  asymp¬ 
totically  along  any  direction  for  finite  initial  conditions.  We  adapt  the  definition  of  asymp¬ 
totic  stability  given  in  [8]  for  use  in  the  multidimensional  case. 

Definition.  The  shift-variant  m-D  system  in  (1)  is  asymptotically  stable  in  the  region  (i 
if  and  only  if  for  any  finite  initial  condition  and  any  sequence  of  {q(n)}  6  G,  the  response 
y(n)  tends  to  zero  asymptotically  on  5C^  as  ^  oo. 

Note  that  since  we  are  dealing  with  linear  systems,  the  concept  of  global  asymptotic  stabil¬ 
ity  is  equivalent  to  that  of  asymptotic  stability.  Note  also  that  this  definition  places  no  restric¬ 
tions  on  the  rate  of  change  of  the  coefficients.  It  also  implies  that  if  we  can  find  one  se¬ 
quence  of  coefficient  values  contained  in  a  region  for  which  a  nonconvergent  response  is 
obtained,  that  region  is  not  a  stable  parameter  region. 


3.  Main  results 

Theorem  1.  The  linear  shift-variant  m-D  system  described  by  (1)  and  (2)  is  asymptotically 
stable  if  and  only  if  7  <  1. 

Proof.  (Sufficiency)  If  we  can  show  that  the  zero-input  response  of  a  m-D  system  is  bounded 
along  hyperplanes  and  that  the  absolute  bound  on  the  response  on  each  hyperplane 
converges  to  zero  as  K  approaches  infinity,  we  can  conclude  that  the  system  is  asymptotically 
stable. 
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Step  1.  Note  that  for  n  6  one  can  always  find  a  B  sufficiently  large  such  that 
|y(n)|  <  B.  Furthermore,  by  choosing  K  sufficiently  large,  the  initial  conditions  needed 
to  compute  output  values  on  are  all  zero.  Now  examine  the  bound  on  the  output  values 
for  n  €  ^K+\^  given  the  condition  stated  in  Theorem  1. 


«/(«)>’(«  “  D 


<  Yj  I«/(«)I  ■  lx«  -  ol 

/6£I 


<5-2  l«/(«)l 

<5*7. 

Since  7  <  1,  and  |y(A2)l  <  B  for  all  n  satisfying  n  6  all  outputs  on  any  hyperplane 
that  satisfies  K  >  K  are  bounded  in  magnitude  by  5  •  7. 

Step  2.  Next  we  obtain  a  bound  for  |y(n)|  on  the  hyperplane  when  K  >  K  -i- 


l3'(«)ln€3C^+, 


S  -  D 


<  •  lx«  -  ol 

<  B  •  y  •  2  l«/(«)l 

<  B  ■  y^. 


Step  3.  By  induction, 

lx«)i  <5-7"+' 

for  «  €  where  K  >  K  M{Ni  +  •  •  •  +  and  M  is  a  nonnegative  integer.  Since 

from  (2),  we  know  that  7  <  1,  then  as  M  ^  00,  7^  0,  and  the  bound  on  \y(ri)\ 

approaches  0. 

(Necessity)  If  there  exists  a  first  hyperquadrant  causal  sequence  of  coefficients,  {a(n)} , 
n  €  91 0,  which  does  not  produce  an  asymptotically  convergent  system  response  y(n), 
then  the  uncertain  shift-variant  system  in  (1)  is  unstable. 
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We  will  now  show  that  if  7  >  1  we  can  always  produce  a  nonconvergent  system  response. 
Without  loss  of  generality,  consider  the  response  y(ni,  0,  . . . ,  0)  along  the  rii  axis.  Choos¬ 
ing  ai(rt)  =  0  for  0,  y  =  2,  . . . ,  m,  we  are  left  with  an  instantaneous  output  mask 
that  is  one-dimensional;  i.e.,  the  outputs  propagate  along  the  axis.  We  describe  this 
system  as  follows: 


y{ni,  0,  . . 0)  =  XI  0,  . . -  /[,  0,  . . 0). 

'1  =  1 

Now  if  these  coefficients  satisfy 

iVi 

X  ...,0)|  <  7,  7  >  1, 

'1  =  1 

a  system  which  is  not  asymptotically  stable  can  be  constructed  by  the  1-D  result  given  in 
[8].  This  is  true  because,  since  7  >  1,  it  is  possible  to  select  a  sequence  of  coefficient 
values  that  prevents  this  response  along  the  nj  axis  from  converging  to  zero.  (Asymptotic 
stability  requires  the  response  to  converge  to  zero  in  all  possible  directions.) 

Theorem  1  describes  a  necessary  and  sufficient  condition  for  the  asymptotic  stabil¬ 
ity  of  (1)  and  (2)  that  holds  for  all  n  €  91  o-  The  region  d  defined  by  this  condition  is  a 
closed  high-dimensional  hyperdiamond  centered  at  the  origin  in  the  interior  of  the  unit 
hyperdiamond. 

Furthermore,  7  <  1  limits  the  size  of  the  largest  stable  hyperdiamond  in  the  coefficient 
space  that  is  fully  symmetric  around  zero.  This  is  true  for  shift-variant  and  shift-invariant 
systems. 

Note  that  while  Theorem  1  addresses  the  stability  of  shift-variant  m-D  systems,  we  can 
also  specify  the  largest  stable  hyperdiamond  for  the  shift-invariant  case: 

X  l«'l  ^  7  <  1-  (4) 

To  show  that  the  condition  on  7  is  necessary,  consider  the  system 


Xw)  =  X  -  0- 

If  the  coefficients  can  be  chosen  from  the  hyperdiamond  described  in  (4),  then  we  can 
certainly  choose  ci^  q  q  =  7  and  ai  =  0  for  all  other  i  €  6.  Clearly,  7  must  be  less 
than  1  for  the  system  response  to  converge  to  zero. 

By  using  information  about  the  previous  system  outputs,  a  less  restrictive  shift-variant 
sequence  of  regions  G(n)  in  the  parameter  space  can  be  identified  for  each  n  €  9Xo . 
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Theorem  2.  The  m~T>  system  described  by  (1)  is  asymptotically  stable  if 


a{n) 


a{n)  €  “  7 


max{|y(« 


ol} 


< 


Yi  ^iWy( 


«  “  /)  <  7  •  max{ly(n  -  i_) 


(5) 


where  0  <  7  <  1. 

Proof.  If  a{n)  is  chosen  such  that 

|y(n)l  <  7  •  max{|y(n  -  0|},  0  <  7  <  1,  (6) 


we  can  construct  an  exponentially  decaying  upper  bound  on  the  response  y{n).  In  fact, 
using  (1)  to  make  a  substitution  for  y(n)  in  (6),  we  have 


Y  ai{n)y(_n  -  /) 


7  '  max{|y(n  -  0|},  0  <  7  <  1. 


(7) 


This  means  that  we  can  express  (i{n),  the  shift-variant  region  of  stability,  as  the  intersec¬ 
tion  of  two  half-spaces  with  parallel  boundaries: 


-  7  •  max{|y(n  -  /)|}  <  “  0  ^  7  ‘  niax{|y(n  -  Ol}*  (8) 

Remarks.  The  region  (l{n)  consists  of  the  intersection  of  two  half-spaces  with  parallel  boun¬ 
daries  in  the  coefficient  space,  and  the  volume  of  this  region  is  infinite.  One  could  think 
of  a(n)  as  a  conveniently  ordered  vector  of  the  m-D  shift-variant  coefficients  in  (1)  and 
y(n)  as  the  corresponding  vector  of  previous  outputs.  We  can  then  express  (1)  as  an  inner 
product  of  afn)  and  yin).  So  we  can  speak  of  the  boundaries  of  the  intersecting  half-spaces 
in  the  coefficient  space  as  being  orthogonal  to  y(^)-  Note  that  the  construction  of  the 
shift-variant  region  of  Theorem  2  requires  information  about  previous  system  outputs.  This 
region  always  includes  the  shift-invariant  region  of  Theorem  1.  In  the  case  where  we  have 
bounded  coefficients,  input-output  stability  is  also  guaranteed  because  we  have  exponen¬ 
tial  zero  convergence  of  the  zero-input  response  [17]. 

This  result  has  important  consequences  in  the  field  of  adaptive  filtering.  The  construc¬ 
tion  of  the  shift-variant  region  allows  for  a  reduction  in  error  in  the  choice  of  updated  coef¬ 
ficients  in  an  adaptive  system.  Usually,  the  computed  coefficients  are  projected  inside  the 
stable  region  of  the  shift-invariant  system  [18].  Using  the  shift-variant  region  of  Theorem 
2,  the  error  due  to  projection  could  be  significantly  reduced  compared  to  the  case  which 
requires  projection  into  the  parameter  region  of  shift-invariant  system  stability. 
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4.  Conclusion 

This  paper  addressed  the  problem  of  asymptotic  stability  of  shift-variant  multidimensional 
difference  equations.  The  largest  shift-invariant  region  of  stability  that  is  symmetric  with 
respect  to  zero  in  the  coefficient  space  was  found.  A  shift-variant  sequence  of  regions  of 
stability  with  infinite  volume  was  also  constructed.  These  results  extend  the  1-D  results 
of  [8] .  For  adaptive  filtering  applications,  the  results  allow  reduced  error  in  choosing  up¬ 
dated  filter  coefficients. 

The  work  here  also  introduced  a  useful  methodology  for  analyzing  the  response  behavior 
of  m-D  systems.  The  usefulness  of  the  concept  of  absolute  response  bounds  is  not  limited 
to  stability  analysis.  The  techniques  used  throughout  this  paper  may  also  be  useful  in  assess¬ 
ing  system  performance. 
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